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Preface 


Тһе measurement of intelligence has been one of psychology's 
most outstanding accomplishments. Since 1905 when Binet and 
Simon first presented a graded series of intellectual tasks to be 
used in assessing a child's level of mental growth, hundreds of 
intelligence tests have been written and published for use in 
schools, employment offices, clinics, and the military services. 
From a practical point of view, they are a great success. In our 
complex, swiftly changing world, it is an advantage to be able 
to sort people out into groups differing in the kind of intellectual 
performance to be expected of them before they enter a course, 
а training program, or a job. instead of waiting for them to sort 
themselves out by the way they function in the situation. There 
is a constant and increasing demand. Intelligence tests sell. 

From the beginning, however, intelligence testing has been the 
focus of criticism and controversy. Some of the criticisms re- 
sult from misunderstandings about the purposes and limitations 
. of psychological testing. Some of them come as a consequence 
- ef the misuse of tests by persons inadequately trained to select, 
administer, and interpret them. But some of them represent 
genuine and important psychological issues and value considera- 
| tions that we should take seriously if we desire to: improve our 
ad ‘social institutions, The question of whether intelligence is a uni- 
E trait or only a name for a combination of loosely related, 

separately developed aptitudes for special kinds of thinking, for 
example, is not a trivial one. What we think about this will in- 
| uence our decisions about many other things, such as school 
. policies, employment and unemployment, and the meaning of 
. political equality. 
Like so many psychological issues, these basic questions are 
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cropping up in altered forms, decade after decade. But knowl- 
edge advances in ascending spirals, so that more penetrating and 
informative research investigations can be planned each time an 
old question recurs. 

The purpose of this book is to bring together some definitive 
studies and statements on these recurring issues. The dates of 
y the papers included range from the 1920's to the 196075. With 

some notable exceptions, more emphasis has been given to the — | 
_ Jater rather than the earlier attempts to deal with the problems, 
. because the later ones rest оп a stronger foundation of research. n ^ 
— knowledge. Each of them, whether it came early or late in the E 
history of the intelligence-testing movement, has been inclu d TNR 
"because it brings to us something we should know or unders! i 
if we are to use intelligence tests intelligently in our effort to 
build a rich and rewarding human society. қ 


LEONA E. TYLER k 


Contents 


Preface 


Part I—THE PROBLEM OF DEFINITION 


INTELLIGENCE AND ITS MEASUREMENT: 


| А SYMPOSIUM 


Е. L. Thorndike, І. M. Terman, Е. N. Freeman, 
S. S. Colvin, Rudolf Pintner, S. L. Pressey, V. A. C. 
Henmon, Joseph Peterson, L. L. Thurstone, Herbert 
Woodrow, M. E. Haggerty 


. INTELLIGENCE AS THE TESTS TEST IT 
| Edwin С. Boring 


TELLIG GENCE TEST SCORES AS INDICATIVE 
чишу то LEARN 


CONCEPT ATTAINMENT: EFFECT 
. TEL ON AT Two LEVELS | 


viii 
Part III—INTELLIGENCE AND TEMPERAMENT 
6. COGNITIVE, CONATIVE, AND NON-INTELLEC- 


TIVE INTELLIGENCB 
David Wechsler 


7. А NONINTELLECTUAL INTELLIGENCE TEST 
Harrison Gough 


Part IV—INTELLIGENCE OR INTELLIGENCES? 


8. THE ABILITIES OF МАМ” 
Charles Spearman 


9. THREE FACES OF INTELLECT 
J. P. Guilford 


10. THE STUDY OF GIFTEDNESS: 


А MULTIDIMENSIONAL APPROACH 
J. W. Getzels and P. W. Jackson 


Part V—THE GROWTH AND DECLINE OF INTELLIGENCE 


11. ON THE GROWTH OF INTELLIGENCE 
Nancy Bayley 


Part VI—THE NATURE-NURTURE CONTROVERSY 


12. SCHOOLING MAKES A DIFFERENCE 
Irving Lorge 


13, DEPRIVATION, DEVELOPMENT, 
AND DIFFUSION 
Susan W. Gray and Rupert A. Klaus 


CONTENTS 


75 


121 


141 


CONTENTS | іх | 
1 . 1 
14. THE INHERITANCE OF MENTAL ABILITY 20718 
| Cyril Burt 
15. HEREDITY, ENVIRONMENT, AND 
THE QUESTION “HOW” 237 
Anne Anastasi [ 
R 
Part VII—INTELLIGENCE TESTING AND ITS CRITICS ` 
16. LOST: OUR INTELLIGENCE? WHY? 259008 
— . Quinn McNemar 
: t 
hà 
d 
b 
1 
1 
Г 


qe TERMES 


Бе ov 


ы "у. 


= 
255 
ж.а 


z 


3 THE PROBLEM OF DEFINITION 


1 


Intelligence and Its Measurement: 
А Symposium 


When psychologists first began to grapple with the new task 
of measuring intelligence, they assumed that everyone agreed 
about what was meant by the term. But it soon became apparent 
that there was no general agreement at all about this. Іп 1921 
a very influential symposium brought together the views of four- 
teen of the leading investigators of the time. The portions of this. 
symposium included in the following pages highlight the differ- 
ences in definition and call attention to the major problems with 
which the testing movement was to struggle in the decades ahead. 

The first selection, then, is an abridged version of "Intelligence 
and Its Measurement: A Symposium" from the Journal of Edu- 
cational Psychology, 7921, 12, 123—147 and 195-216. 


Editorial introduction: Probably the most striking advance of 
our generation in the practical application of psychological tech- 
nic to educational and social affairs is the movement for the 
definition and measurement of intelligence. Especially impres- 


sive is the widespread effort now devoted to the construction 


and use of individual and group tests. It appears that this is an 


opportunity for this journal to serve as an effective clearing house | 


for mature opinion on a most important problem. Accordingly, 
we have asked 17 leading investigators to contribute to a sym- 
posium on the following topics: 


"(1) What I conceive ‘intelligence’ to be, and by what means it can | 


best be measured by group tests. (For example, should the ma- 
terial call into play analytical and higher thought processes? 
Or, should it deal equally or more considerably with simple, 
associative, and perceptual processes, еіс.2)” 

“(2) What are the most crucial ‘next steps’ in research?” 
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Those invited to take part were: Doctors Bell, Buckingham, 
Colvin, Dearborn, Freeman, Haggerty, Henmon, Peterson, Pint- 
ner, Pressey, Ruml,* Terman, Thorndike, Thurstone, Whipple, 
_ Woodrow, Yerkes. 
- ОҒ these, all but three have signified their desire to contribute 

material. We print in this issue statements by Drs. Thorndike, 
Terman, Freeman, Colvin, Pintner, Ruml, and Pressey. Contri- 
_ butions from the other workers will be published in the April 
_ issue. 

The editors hope that a vigorous discussion will grow out of 

- these initial statements and will present further phases of the 
4 matter іп subsequent issues of the Journal. 


By E. L. THORNDIKE к 


Teachers College, Columbia University ... 


y 
_ 1. The nature and measurement of intelligence. If we inven- 


tory the behavior of men and try to divide it up according as 
tellect, character, skill, taste or temperament is primarily in- 
olved, we shall agree fairly well in, say, ninety per cent of the 
cases. If, however, we try to make the division absolute we may 
agree very seldom. It is probably unwise to spend much time 
in attempts to separate off sharply certain qualities of man, as 
_ his intelligence, from such emotional and vocational qualities as. 
- his interest in mental activity, carefulness, determination to re- 
_ spond effectively, persistence in his efforts to do so; or from his — 
amount of knowledge; or from his moral or esthetic tastes, Even _ 
so apparently remote a trait as muscular strength may in some ) 
cases cooperate almost indistinguishably in the production of 
what we would all call intellectual products. Thus a great schol- 
ar's achievement may be in part due to eye muscles which help. 
| make reading а pastime. ; 
Ж Taking these cases of behavior which аге generally accepted: 
as matters of intellect and trying to place each as primarily a 
( matter of response to situations directly sensed, or as primarily | \, 
a matter of planning, we shall again agree fairly well. So als 


+ The statements of Ruml (VI) and Dearborn (XII) have bi 


mitted.—ED. 
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if we rate them as primarily responses to concrete particulars ог | 
primarily responses to abstract qualities and relations. It would | і 
however be difficult and probably unwise to try to separate off 
sharply the responses concerned with directly sensed situations vi 
from responses concerned with planning; or those concerned with - 1 
concrete features of things and men from those concerned with | 
ideas and symbols. Hoeing corn and shooting a rabbit are easily | 
distinguished from studying botany and ballistics, but behavior | 
shows all sorts of intermediate forms. 

Realizing that definitions and distinctions are pragmatic, we | 
may then define intellect in general as the power of good re- 
sponses from the point of view of truth or fact, and may sepa- 
rate it according as the situation is taken in gross or abstractly - 
and also according as it is experienced directly or thought of. | 
The power of good responses to abstract qualities and relation 
rather than gross total facts and to ideas rather than direct ex- 
periences may be called the more intellectual variety of intel- 
lect. 

Either variety is, as human beings now are, specialized fur- 
ther according to the data operated on in the response and ac- 
cording to the form of the operation. The goodness of the r 
sponse in any individual varies according to the particular tas 
The child who is the best of a thousand of his age at the un- / 
doubtedly intellectual task of mental multiplication of two-plac 
numbers will not be the best at the equally indubitably intelle 


rom space relations to animals, to plants, to machines, to mor 
sues, to numbers, the correlation never holds up to 1.00. А: 
ге change from accuracy in,perception, to accuracy in memor: 
о accuracy in inference, all with the same data, the correlatio! 
in fails to hold at 1.00. 
ү _ A part of this break to below perfect correlation is presi 
4 ably due to circumstances of life and training which have give 
ike amounts of emphasis to different data and to differe 
forms of operation in the case of each of the thousand. But 
ў thousand were taken who had had identical training, it seems. 
m ain that the specialization of intelligence would still be foun nd 
VN correlations still failing to be unanimously 1.00. 
Inm easuring a person’s general | pratus in AN, and i 
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in general is, what we do is to test him with a fair sampling of 
data and operations. If his opportunities of training in respect 
to these have been inferior or superior to the group with whom 
he is to be compared we make the necessary allowance. This 
sampling should be wide enough and its various components 
should be easily enough weighted, so that the resulting judgment 
should be about his general status and general capacity—if we 
are to claim that it is general. 

Some of us have, I fear, claimed a generality for our meas- 
ures of status and a surety of inference from them to original 
inborn capacity which it would be very hard to justify. The esti- 
mates which the psychologist makes with his tests are much bet- 

ter than those which parents or teachers or ordinary medical 
practitioners make of the same facts, so that we are justly proud 
of them, but we should be the first to recognize their limitations. 
Тһе value of a test score is its value in prophesying how well a 
person will do in other intellectual tasks. Our claims ma 
be limited to the actual demonstrated power of prophecy. Бог | 
example, consider a score attained by a 12-year-old boy in say 
а combination of Stanford Binet, National A and B and Hag- 
gerty Delta 2 (two trials of each). If the boy ha 
American opportunities, this score will prophesy rather accu- 
rately how well he will respond to intellectual demands in the 
cases of "book-learning" at the time and for some years there- 

. after, and very possibly for all his life. It will prophesy less 
accurately how well he will respond in thinking about a machine 
that he tends, crops that he grows, merchandise that he buys 
and sells and other concrete realities that he encounters in Us 
laboratory, field, shop and office. It may prophesy still less ac- 

curately how well he will succeed in thinking about people ana 
their passions and in responding to these. We know that taking 
people as we find them, the ability measured by verbal tests m 
not the same as the ability measured by non-verbal tests; and 
there is reason to expect other similar specializations, É 

The intercorrelations of these various "j 
course, high enough to make a measure of 
better index of any other than the average parental hope or 

I teacher's opinion is likely to be. If our 12-year-old boy is at the 
five-percentile station in our tests it will rarely happen that he 


y wisely 


s had ordinary 


intelligences” are, of 
any one of them a 
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will rank above average intelligence over any large area of 
mental activity; save by the drive of a great interest and the 
expense of much time upon the activity in question. On the 
other hand to assume that we have measured some general power 
which resides in him and determines his ability in every variety 
of intellectual task in its entirety is to fly directly in the face 
of all that is known about the organization of intellect. 


The relative weight to be attached to analytical and selective. 


and to perceptual and simple associative processes can only be 
decided by the correlations and partial correlations of these with 
the criterion which the test score is to prophesy, or some experi- 
mental facts giving equivalent information, considered with due 
reference to the time-cost of making the prophecy. In general, 
tasks which require efficiency in analyzing a situation into ele- 
ments, selecting and weighting elements to fit a problem and 
organization or thinking many things together seem to give much 
better results per dollar or hour of cost. They perhaps include 
and sum up the action of many simpler associative processes. 
But a straightforward information test is also a valuable element. 
If time-cost is disregarded, a sampling of every kind of intel- 
lectual operation, and with every kind of datum, will, if properly 
weighted, improve the prophecy of general intelligence. Unless 
it is properly weighted, however, it may injure it. 

2. Next steps in research. Having used up my allotment of 
Space in the previous discussion, I can only note that more re- 


search into every feature of intelligence and its measurement is 
needed, especially researches on the intercorrelations "total" and | 


“partial” of the various forms of intellectual work of the world; 
on the intercorrelations “total” and “partial” of the abilities used 
and usable in our tests; on the permanence of our IQ's and 
ЕО”; and on the "total" and "partial" correlations of each test 
at each age with itself at later ages and with each feature of the 


intellectual work of the world. The form of distribution of in- 


telligence in the general adult population is also a matter of | 


great practical moment. In relation to educational and industrial 


uses the problem of the effect of "coaching," special and general, 2 


is fundamental. 
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IL. By L. M. TERMAN 
Leland Stanford University 


1. The T and measurement of intelligence. Meumann has 
pointed out that the fault of Stern's teleological definition of in- 
telligence as “general adaptability to the new problems and con- 
ditions of life,” lies in the fact that it furnishes no clue for 
judging the value of different kinds of adaptation. Meumann 

. would reverse Stern's procedure by first finding out what is de- 
manded of intelligence and then analyzing the mental functions 
which meet that demand. In my opinion this is the only method 
of approach which will bring us any nearer to a psychological 
solution of the intelligence problem. 

If we accept this view it is evident that the important intellec- 
tual differences among men will not be fo 

= perceptual, or purely reproductive level. It 

| а moron may be able to see, hear, 

signal, balance a bicycle, 
about as well as an intellec. 
what his superior in mem 

. cel him still more in logi 

7. hopelessly in the ability to 

- of sensation and memory. 

in the capacity to form co 

.. to grasp their significance. 

portion as he is able to carry 


n our grounds for designating any 
. kind of mental activity as “higher” 


- able to handle tools skillfully, 
is not to be considered neces 
individual who can solve math 


acquire a huge 
that the two 


"neither of which is higher or better than the rie. 


It is difficult to argue with anyone whose sense of psycholo 
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cal values is disturbed to this extent. Such an individualistic 
view is not disposed of by calling attention to the obvious fact 
that civilization, with its science, art, government, religion, phi- 
losophy, and systems of credit, is unthinkable except as a prod- 
uct of concept elaboration and symbolic thinking; our opponent 
can retort that it is only our intellectual snobbery which leads 
»| us to regard the state of so-called civilization as "higher" than 
E that of primitive man! 

ba It can not be disputed, however, that in the long run it is the 
races which excel in abstract thinking that eat while others starve, 
survive epidemics, master new continents, conquer time and 
space, and substitute religion for magic, science for taboos and 
. . justice for revenge. The races which excel in conceptual think- 
=“ ing could, if they wished, quickly exterminate or enslave all the 
. races notably their inferiors in this respect. Any given society | 
is ruled, led, or at least molded by the five or ten per cent of its 
members whose behavior is governed by ideas. The typical pick- | 
and-shovel man does his thinking chiefly on the sensori-motor 
and perceptual levels. Add a little more ability to think on the 
. representative level and he may be able to repair your automo- 
= bile, build you a house according to an architect's specifications, 
1 or nurse you in illness. Add а large measure of ability to asso- 
ciate abstract ideas into complex systems and he can design а. 
new type of engine, draft the plans for a skyscraper, or. discover 
1s _ a curative serum. E 4 
22 What I have said may seem like an over-elaboration of the — 
obvious. Such a discussion ought, indeed, to be unecessary. Un- | 
fortunately it is not. Many criticisms of the current methods of | "m 
testing intelligence rest plainly on a psychology which fails to 
istinguish the levels of intellectual functioning or to assign t 


Í symbols), this is sufficient in the eyes of some psychologists 
ondemn it as non-valid. The subject who can not acquiri 
7. rmal vocabulary, see the point of а fable, or be taught to 
. read a paragraph with understanding is considered to have dem: 
onstrated his intelligence if he can trace a simple maze or 

е fragments of a formboard. In fact the “idea thinker 
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is sometimes spoken of disparagingly ог even а little .contemp- 
tuously, particularly in the case of a child whose superior ability 
in this respect places him in conspicuous contrast with other 
children of the same age. 

But if intelligence is the ability to think in terms of abstract 
ideas, we should expect the most successful intelligence tests to 
be just those which involve the use of language or other symbols. 
We should also be justified in demanding that an intelligence test 
should correlate well with what we may call “school educability." 
As a matter of fact it is precisely tests of this type which are 
surviving in the struggle for existence: tests involving arithmeti- 
cal reasoning, language completion, naming opposites, matching 
proverbs, completing analogies, understanding difficult passages, 
etc. The list could of course be greatly extended, but all tests 
which are notably successful in measuring intellectual differences 
among adults have something in common with those named, 


even when they work with concrete materials instead of with 
words. . . . 


Ш. By Е. №. FREEMAN 
University of Chicago 


1. The nature and measurement of intelligence, 
intelligence to be a somewhat more inclusive capacity than is 


implied when it is used as a name for Our present tests. For this 
Teason, it seems to me that it would be b 


somewhat narrower connotation to desi 
mental capacity designated by the ter 
me to include, besides the elements wh 
by our tests, certain other t 
scarcely at all. 


Тһе capacities measured by our tests may be described from 
the structural point of view as involving chiefly: sensory capac- 
ity; capacity for perceptual recognition; quickness, range of 
flexibility of association; facility in imagination; span or steadi- 
ness of attention; quickness or alertness in response. Excellence 
in capacities of this sort is well designated by the term bright- 


I conceive 


gnate these tests. The 
m intelligence seems to 
ich are usually measured 
урев of capacity which they measure 
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ness. We recognize, however, that a person's achievement, or 
even his intellectual capacity, does not seem to correspond per- 
fectly with his capacity in any of these various specific traits 
or with all of them put together. We sometimes say that a per- 
son is very bright but not very intelligent. We mean that he 
does not use his mental powers in such a way as to be most 
productive. The characteristic which I am referring to is some- 
times called temperament or moral character, but it seems to 
me it can be shown that there are certain intellectual traits 
which are left out of our present scheme of tests and which 
should be included in a total conception of intelligence. 

These additional characteristics may be described as: mental 
balance; co-ordination of the mental processes; the judicious 
management of the processes of learning or reflection; mental 
control; mental adjustment; the direction of the attention toward | 
the significant aspects of experience; a due degree of non-sug- | 
gestibility; the adoption of intellectual purposes and the adap- 
tation of means to. their satisfaction; sensitiveness to significant 
combinations between experiences which illuminate one another 
or which are effective in building up systems of thought; bal- 
anced and sane reaction to the entire world of things, ideas and 
persons. . . . 


IV. By S. S. COLVIN 
Brown University 


1. Nature and measurement of general intelligence. General 
intelligence has been defined as "general mental adaptability to 
new problems and conditions of life." To my mind this defini- | 
tion is somewhat too narrow. In a very true sense intelligence 
is mental adaptability to environment. This conception, how- 
ever, is in one respect too broad since it includes instinctive 
adaptations as well as those that have been acquired through 
experience. Of course, Psychologists sometimes speak of the 
psychic life of micro-organisms and frequently use the term 
intelligence in connection with instinctive acts of such animals | 
as ants, bees and wasps, whose adaptations to environment seem 
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to be almost entirely on the plane of instinct. On the whole, 1 
consider the most helpful viewpoint from which to consider in- 
telligence is that it is equivalent to the capacity to learn. Ап 
individual possesses intelligence in so far as he has learned, or 
can learn to adjust himself to his environment. In a sense this 


Y theoretically. An inspection of intelligence examinations clearly 


7! В 


f 
1 
% measure an individual" 


- elements necessary in solvin 
- completion, thought interpre’ 
membered that even the abili 


- validity of all mental testing Я 
tion that those tested have h: 
n skills, facts, principles and methods of 
- fied in the tests. It follows for this reason that many of the 
- standard school tests now in use are reasonably good measures 
B. only of specific aspects of acquired intelligence, but also 
- of general (innate) intelligence. All the individuals in the School 
И group tested һауе had the same training, or at least Very similar 
training. Some have learned more, others, less; those who have 


procedure exempli- 
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learned less possess less learning capacity,—hence less general 
intelligence. . . . 


V. By RUDOLF PINTNER 


The Ohio State University 


1. Nature and measurement of intelligence. I have always 
thought of intelligence as the ability of the individual to adapt 
himself adequately to relatively new situations in life. It seems 
to include the capacity for getting along well in all sorts of 
situations. This implies ease and rapidity in making adjustments | 
and, hence, ease in breaking old habits and in forming new ones. 
Fundamentally, this leads us back to the general modifiability 
of the nervous system. Ап organism whose nervous system is. 
very modifiable can adjust itself quickly to new types of situa- 
tions and in this way react with more intelligence to a greate: 
number of situations. | 

Тһе reactions to which we apply the terms "intelligent" or D 
"unintelligent" are differentiated from those to which we apply. 
the term “emotional,” although any sharp division between these 
two types can hardly be made. Nevertheless, the distinction is 
а practical one which it is useful to retain. . . . 

Because we are dealing with something which we hardly kno 
how to define, because we are groping for means to measure | 
reactions to extremely complex and different situations, we must. 
be very careful not to limit in any way the type of material we 
use. Intelligence is shown in dealing with things as well as with 
words, in dealing with living men and women as well as with | 
symbols, in handling a paint brush or chisel as well as a pencil, 
in carving stone or laying brick as well as in making verba 
Tesponses. We, therefore, need intelligence tests of all type: 
And by intelligence tests I mean tests of the general ability to 
do all sorts of things as opposed to educational and trade tests. 
which are specifically made to measure the knowledge which 

- individual has been directly taught. If we believe in this la 
. view of intelligence, we are painfully aware of the paucity 0 
.. tests that exist at the present time. I cannot believe that we have 
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exhausted our ingenuity in the construction of different types of 
tests and I hope to see many new types of tests constructed in 
the future. АП sorts of tests and various combinations of all sorts- 
of tests are needed... . 


УП. Ву S. L. PRESSEY 
University of Indiana 


1. Intelligence and its measurement. The writer has been 
asked for a statement as to what he conceives intelligence to be, 


and as to what types of test materials can best be used for the 
measurement of intelligence, Frankly, 


terested in the question—although a la 
to work with tests of “intelligence, 
know what such tests will do, in 
Suppose, for instance, one is inten 


he is not very much in- 
rge part of his time goes 
” Instead, he is interested to 


then, a “general” test, 

After a number of such tests 
step is, naturally, to evaluate the 
with which they deal with the p 
tion of which they were made. 
give the tests to (1) a Broup of child 
long and intensive study of them, 
and (2) another group known to 
Тһе tests which separate these two grou 


have been made up the next 
m according to the efficiency 


Measurement of capacity for school wi 


3 ork by such a para- 
phrase of school work, but with the spec 


ific elements of School- 
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ing left out, is surely a very natural thing to do. It is also natu- 
ral to attempt the selection of children at the other extreme— 
the exceptionally bright children, who are capable of more ad- 
vanced work than they are now doing—by means of such tests. 
The capacity of these children for this advanced work cannot 
be determined by giving them some of this advanced work to 
do; the point of the whole situation is that opportunity has not : 
been given to acquire the specific elements in this advanced 
work. In fact, any effort to get back of the school's actual dispo- 
sition of its children, into classes and grades, naturally suggests | 
the use of such paraphrase of school work, but with the specific 
elements eliminated. And the usefulness of different types of 
this material must be determined by actual trial with the con- 
crete problem to be dealt with. 

Well—and if such tests are of service in dealing with a vari-. 
ety of problems one may come to think of them as tests of a 
fundamental, unitary, general intelligence. An elaborate theory, 
with elaborate statistical expression, may then be developed. 
But the hypothetical nature of the concept must be Кері in 
mind (and the educational situation which first gave rise to 
such tests, also). Particularly, one must not permit himself to | 
be hypnotized by the statistics. Always, it must be kept in mind | 
that there is no value in measuring intelligence simply for the | 
sake of measuring it; the tests are given in an effort to deal with 
some practical problem. And it is in proportion as they deal effi- 
ciently with that problem that they are to be considered satis- - 
factory. 

Frankly, then, the concept of general intelligence is for the 
writer, primarily, simply a working hypothesis which has been | Ы 
very helpful in the first attack upon problems of prognosis. It 4 
should continue as а working hypothesis until other hypotheses - 
are found to work better. But investigators must not be so \ 
dominated by the concept of general intelligence that they fail. 
Seriously to consider other possibilities. Particularly to be. 
avoided is the easy notion that a test of intelligence will solve | 
all educational difficulties, that intelligence testing is the longed 
for short-cut method which will put everything in the schools 
finally and completely to rights. The theory is simply an assump- 
tion that РЕНО problems сап be generalized. It has been. 
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in suggesting certain general lines of approach—and 
т pele ae to PES the otherwise impossibly complex 
prognosis problem. It will do equally great harm if it prevents 
analysis of the prognosis problem, now that methods are becom- 
ing sufficiently refined to make this possible. The safest, most 
empirical, and most practical method of making this analysis 
(to the writer's mind) is to study the relation of the tests to 
particular practical problems. From such study any general 
factors will, in time, emerge of themselves. 


УШ. By V. А. C. HENMON 


"University of Wisconsin 


— 1. The nature and measurement of intelligence. Intelligence, 
in the ordinary acceptance of the term, has been defined by 
] 


Lester Б. Ward to be “intellect coupled with the product of its 
operation,” ог in other words, "intelligence is intellect plus 
nowledge." This certainly corresponds to the use of the term 


doing violence to language the psy 


A 
The untutored savage or barbari 
TN but without knowledge 
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not be materially changed by anything we do. Achievement tests 

while measures of knowledge possessed are in turn indices of 
capacity for knowledge, though valueless for comparative pur- 

poses of crude, uninstructed intellect, only because there has | 

been no guarantee of equality of opportunity. Intelligence tests, қ 

оп the other hand, as at present constituted, are a mixture in . 

varying proportions of tests of knowledge, for example, the 

constantly recurring tests of arithmetical reasoning and of in- | 

formation, with those whose novelty is such that specific past 

experiences function much less readily and there is an approxi 

mation toward relative equality of opportunity. In any case, | 

both groups of tests are measures of both native and acquired 

intelligence with differences in emphasis. The high correlations 

between intelligence tests and achievement tests and the high 

і correlations between intelligence tests and teachers’ estimates 

ог scholastic standings indicate their essential similarity. Teach- | 

j' ers’ estimates and school marks, which are used as measures of | 

reliability and validity of intelligence scales, in default of any 

absolute standard of reference, are based on what children | 

1 know апа on their capacity to know. 

Intelligence ought to retain this broad significance. To define | 

| it with Stern as “а general capacity of an individual consciously. 

К, to adjust his thinking to new requirements,” which is substan- 

tially James' definition of reasoning, or with Meumann as a 

М general capacity for "independence, originality and productive- 

ness in thinking” is to narrow its meaning arbitrarily and to 

neglect its compound nature. The scholarly or erudite man "who. 

has merely acquired the knowledge | created by others may not. À 


ba 


Pendent, original and productive in his thinking, but we should | е 
scarcely say that hé is unintelligent. Intelligence is indicated by | 
the capacity to appropriate truth and fact as well as by the | 
capacity to discover them. E 

What we want, of course, is a measure of crude intellect o А 
telligence. Any test which requires mental processes, be they 
either on the sensory-motor level or on higher levels, which. 
, measures the sensitiveness, responsiveness, and retentiveness of. 

the nervous system, is a test of intellectual capacity. It is onl I 
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because of the absence of an absolute standard of re the 
inability to discount the effect of past experiences, T3 : inis 
row conception of the meaning of intelligence, that the р 3 2, 
higher mental processes appear to be better measures of inte 
Ject, and not because they involve intellectual capacity any more 
evidently. The essential thing in a test of pure intellect is to 
secure such novelty as to reduce inequality in opportunity and 
training to a minimum, and such complexity as to reveal dif- 
ferences clearly and unambiguously. It is not a matter of the 
kind of mental process involved primarily. A properly constituted 
test of intellect ought, therefore, to take a wide sampling of 50- 
called lower as well as higher processes and the relative weights 
to be assigned to each element determined. The tests must be 
extended to measure the capacity to learn in other directions 
than the ability to use words, signs, and symbols. The so-called 
general intelligence tests are not general intelligence tests at all 
but tests of the special intelligence upon which the school puts a 
premium. Тһе extension of the term intelligence to include 
what Thorndike has called mechanical intelligence, the ability 
to manipulate things, and social intelligence, the ability to 
manage men, means that we need not one, but several scales of 
intellect from which we can secure an intellect profile. We have 
been gradually evolving a type of test for abstract intellect that 
is of use in classification and prognosis in school, but is of no 
convincing value as a measure of general intelligence as such, 
nor of demonstrated value in vocational guidance and direction. 


IX. By JOSEPH. PETERSON 


George Peabody College for Teachers 


l. The nature and measurement of intelligence, Intelligence 
seems to be a biological mechanism by which the effects of a 
‘complexity of stimuli are brought together and given a some- 
what unified effect in behavior. It is a mechanism for adjustment 
and control, and is operated by internal as well as by external 
stimuli. The degree of a person’s intelligence increases with his 
range of receptivity to stimuli and the consistency of his organi- 
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zation of responses to them. In certain higher learning processes 
the bright subject more quickly and systematically enlarges the 
Tange of his cues or "guide-posts," and consequently more 
readily masters the situation than does the dull one, who must 
come back again and again to the more immediate elements. 
The latter cannot keep in mind the complexity of the situation. 
This difference is found to hold for children of very different 
years but equal mental ages, contrary to the results of a well- 
controlled experiment by Woodrow, one, however, the results 
of which seem to me to have been generalized too much by him 
and by some other writers. A dull and a bright child of equal 
mental age have gone through equal mental-age levels, but the 
bright child seems to have made the same acquirements in’ the 
lesser time. ) 

One's emotionality, responsiveness to abstract symbols, degree 
of energy and of perseverance, etc., certainly condition one's in- 
telligence. We cannot analyze such differences here, but can only 
Suggest that equal mental ages by any test do not indicate just 
equal intelligence for all situations. We are probably too prone | 
in our practical work of testing to assume equality of intelligence 
in such cases, since our attention is taken up with the one kind 
of reaction most susceptible to testing. General intelligence, if it 
is a reality at all, is probably not a separate or constant factor, 
but a composite of many different abilities, and probably means 
different things in unlike situations, as different abilities are 
Stressed. Such factors as energy and perseverance, degree of 
disturbance by emotions and self-consciousness, and many others 
that play their roles in one’s success in life, have not yet been 
Successfully brought into the field of measurement by tests, 
especially by group tests. ... 


X. By L. L. THURSTONE 


Carnegie Institute of Technology 


What is meant by intelligence? Intelligence as judged in every- 
day life contains at least three psychologically differentiable com- 
Ponents: a) the capacity to inhibit an instinctive adjustment, b) 
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the capacity to redefine the inhibited instinctive adjustment in 
the light of imaginally experienced trial and error, c) the voli- 
tional capacity to realize the modified instinctive adjustment 
into overt behavior to the advantage of the individual as a social 
animal. . . . 

These three phases of intelligent behavior may be labelled for 
convenience a) inhibitive capacity; b) analytical capacity, and 
с) perseverance. One may possess the inhibitive capacity without 
keen powers of analysis. This leads occasionally to an appearance # 
of intelligence by silence. Such a mind is often capable of recog- 

“nizing and adopting the successful analyses of other minds with- 
out being able itself to produce the analyses. The inhibitory 
capacity for the early, abstract, impersonal stage of instinctive 
adjustment does not necessarily coexist with inhibitory capacity 
for the later more defined and personally significant stage of 
the instinctive adjustment. Hence a man May possess inhibitory 
capacity for abstract impersonal thinking and lack self-control 
for those instinctive adjustments which have reached uninhibited / 
_ а personally and socially significant and overtly defined stage. M 
шап may possess considerable inhibitory and analytical capacity 
and still be socially quite ineffective because of insufficient voli- 
tional drive to realize his intelligence into consistent action. 
. Such a mind is not infrequently the subject of ridicule from those 
who would justify their own mental worth in spite of modest 
| analytical powers. % 
Analytical capacity concerns the preconscious and early con- | 
scious stage in the definition of instinctive adjustment. It implies | 
the capacity to inhibit instinctive pressure at that stage so as to Ww. 
. allow flexibility of definition of the response. This has been pic- — 0 
_ turesquely called by Knowlson free interplay with the subcon- 
scious. It is only natural to expect that such inhibitory capacity 1 
should appear when the instinctive drives are relatively weak. | 
Hence superior analytical ability is not infrequently associated i 
with inferior instinctive energy in its nutritional, sexual, gregari- 
ous, and self-assertative forms. When such an individual dis- 
covers his inferior instinct equipment he may center his self- | 
satisfaction on his analytical powers as a compensation. Such in- { 
. dividuals need the assistance of other volitionally stronger minds 
_ in order to make their labors socially effective. 
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When the analytical capacity is associated in the same mind 
With a fair degree of instinctive and volitional energy we have 
the bright person in practical life. There is a fundamental dis- 
tinction between bright and profound intelligence. The mind 
Which possesses a fair amount of inhibitive, analytical, and voli- 
i tional capacity will in general aim for effectiveness in the imme- 
diate present. Such a mind is bright. When, however, a mind is 


i more generously endowed in all three of these respects or when 
it is unbalanced by reduced volitional capacity, it deals with 
Қ the earlier and more abstract relations in its adjustments. Sucha | 


І © Mind is profound and its analyses concern temporarily remote | 
ends. I am quite sure that our intelligence tests in which the _ 
candidate races against time for a few minutes do not measure 


ІЙ adequately the more inhibited and deliberative profound type 
К of intelligence. It does fair justice to the more frequent well 
b: balanced bright mind. . . . 


ХІ. By HERBERT WOODROW 


University of Minnesota 


1. The nature and measurement of intelligence. In attempting 
.. to state the meaning of intelligence, I should say first that it is 
ап acquiring capacity. One's actual, present capacity for doing | 

= any particular thing is obviously dependent upon his training 
and learning, or, in general, upon his past experience; whereas, іп | 
_ the measurement of intelligence, the attempt is always made to — 
mize the effects of past experience by utilizing performances, | 
the acquisition of the capacity for which is presumably favored | 
Mee ually by the past environments of all the individuals measured. | 
When, for example, we use a child's present capacity to count 
backwards from twenty as a partial index of his intelligence, the Ж 
assumption is, clearly, that the past environments of all children с. 
have been equally favorable for the acquisition of this ability. If — ' 
this ability was one which could be readily taught, and, further, | 
One which was taught some children but not taught others, it - 
ould be valueless as an index of intelligence. The present capac- 
ity to count is a measure of intelligence only in so far as it is 2 
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index of the capacity to learn to count, that is, the capacity 10 
acquire the capacity to count. Intelligence, then, is the capacity 
to acquire capacity. . . . 4 

Now, if intelligence is to be defined as a capacity to acquire 
capacity, it is imperative to define the acquired capacity. I be- 
lieve this capacity may, be correctly described (using neither 
purely mental nor purely behavioristic terms) as the capacity for 
such mental activity as is most effective in bringing about suc- 
cess, or, in slightly different phraseology, as the capacity for suc- 
cess in so far as success is dependent upon mental processes, 
either past or present. By success, is here meant, not success in 
any one line of endeavor, but a theoretical success, namely, suc- 
cess in all those innumerable performances which may be re- 
garded as desirable. The capacity for such a theoretical success 
would have as its practical result success in coping with any situ- 
ation in which the individual might find himself. 

This conception of intelligence implies that mind is an instru- 
ment for the securing of desirable ends. It implies that between 
mind and body there exists a relationship—a fact which I be- 
lieve no living psychologist denies—but does not specify the ulti- 
mate nature of the relationship. Intelligence cannot be defined in 
purely mental terms, because the capacity for acquiring valuable 
modes of mental functioning is itself not mental; it is certainly, 
in part, a matter of the condition of the brain. Moreover, success 
can be attained only as the immediate result of behavior. АП 
"mental measurements," even those concerned with "intensity of 
sensation," are primarily measurements or descriptions of be- 
havior under measured or described environmental conditions. 
On the other hand, intelligence cannot be satisfactorily described 
in purely behavioristic terms, because (I mention only one rea- 
son, one which is persistently overlooked by behaviorists) while 
the degree to which behavior is intelligent is simply the degree 

‘to which it attains success, success has no real meaning except 


by reference to some want, desire, intention, plan, or pur- 
poses... 
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ХІП. By M, E. HAGGERTY 


University of Minnesota 


1. Intelligence and its measurement. In responding to this re- 
quest to participate in the symposium on intelligence I take it 
that what is desired is a more or less dogmatic confession of 
faith rather than a systematic effort to support by evidence and 
argument the beliefs expressed. 

1. In my thinking the word intelligence does not denote а 
single mental process capable of exact analytic definition. It is 
а practical concept of connoting a group of complex mental 
processes traditionally defined in systematic psychologies as sen- 
sation, perception, association, memory, imagination, discrimina- 
tion, judgment and reasoning. The nearest equivalent to this 
Working concept is James' "differentia of reasoning" as "the 
ability to deal with novel data" and Dewey’s well known “forked- 
road" theory. This limitation of the concept of intelligence to 
the "novel-situation" category, so useful for theoretical pur- 
poses, however, seems to me too thin and lean for practical 
purposes of controlling behavior. I prefer to enrich the concept 
with all the fatness afforded by the inclusion of the more ele- 
mentary and subsidiary processes instrumental to the crucial 
act of thinking or reasoning. For the most part, I would exclude 
from the concept, emotions, instincts, will-activities and so called 
character traits. 

2. Intelligence is a dynamic concept. It is descriptive of be- 
havior and not of static component parts of the “mind.” When 
опе conceives of the mind as a “state” or a “structure,” the word 
intelligence becomes meaningless. The implication of activity is 
essential in the concept of intelligence. 

3. Intelligence is native and peculiar to an individual. In this 
Sense it is an instinct defined as an inherited or congenital char- 
acteristic. It may be conceived of as akin to, if not dependent on, 
Or a phase of, the native quality of the phyical organism, the 
brain and nerves. Because of the original differences in intelli- | 
gence or native capacity the same environment affects differently 
different persons. As a result two persons subjected to the same 
environment, say the formal procedures of the elementary school, 
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emerge with different mental content, different habits, different 
interests. These eventuating differences are the criteria by which 
we may infer the quality of the native endowment of the indi- 
vidual. Often these differences among. individuals are less im- 
portant in themselves than they are for such inferential purposes. 
Present attainments аге important in showing what an individual 
can now do. In so far as such attainments may be made the 
basis of inference as to native endowments they are of value 
for prognosis. Because of their superior prognostic value intelli- 
gence tests have a value which mere achievement tests do not 


. have. 


4. Intelligence is not merely a qualitative concept. It may be 
quantitatively considered. When a child has little of it he does 
poorly in school, and in cases of extreme deficiency he is largely 
uneducable. When a child has more intelligence he is capable | 
of learning and individuals gifted with great intelligence may 
learn most rapidly. Similarly in actual life low intelligence means 
simple occupations and crude civilization. High intelligence 
means the possibility of efficiency and leadership in the more 
complex problems of civilized society. 1 


ы. 
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Intelligence as the Tests Test It 


Epwin С. BORING 


The second selection is another early paper, very short and | 


' written primarily for nonpsychologists, but the distinction it 


makes between intelligence in general and intelligence as the tests 
test it has influenced much subsequent thinking. It is by Edwin G. 
Boring, "Intelligence as the Tests Test It," from 'The New Repub- 
lic, 1923, 34, 35—36, and is ац with the permission of the | 
author. ) 


If you take one of the ready-made tests of intelligence and try | 
it on a very large number of persons, you will find that they suc- 4 
ceed with it in very different degrees. Repeat the test, and you à 
will find that they cannot, with the best will in the world to do t 
well, alter their scores very greatly. Then give the same group 
another intelligence test, and you will discover that the differ- 
ences among individuals are approximately, although not exactly, 
the same. And you can go on. You will find that an adult, after - 
continued exposure to his social and educational environment, 4 
does not greatly alter his score on а given test; that children, 
however, do steadily improve their performances until somewhere | 
between ten and twenty years old; that the average age at which | 
improvement stops is about fourteen years; but that children | 
while improving tend to maintain the same individual differences, - 
So that in a given group every child would keep about the same | 
rank within the group. These are basic observational facts of 
the psychology of intelligence. What do they mean? 
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WHAT THE TESTS TEST 


They mean in the first place that intelligence as a measurable 
capacity must at the start be defined as the capacity to do well in 
an intelligence test. Intelligence is what the tests test. This is a 
narrow definition, but it is the only point of departure for a rig- 
orous discussion of the tests. It would be better if the psycholo- 
gists could have used some other and more technical term, 
since the ordinary connotation of intelligence is much broader. 
The damage is done, however, and no harm need result if we. 
but remember that measurable intelligence is simply what the 
tests of intelligence test, until further scientific observation allows 
us to extend the definition. 

An observational method for extending knowledge of intelli- 
gence as the tests test it is the method of statistical correlation. 
Тһе relation to intelligence of any measurable capacity at all 
can be determined by comparing the relative performances of a 
large number of persons in an intelligence test with their achieve- 
ment in the measure of capacity in question. If the correlation 
is considerable, yet not perfect, say 60 per cent, we say that the 
particular capacity is partly dependent upon intelligence and 

. partly independent of it. We shall not be far wrong if we think 
of such a capacity as complex, involving 60 per cent of intelli- 
gence and 40 per cent of some special ability that is not intelli- 
gence, . 

Тһе method of correlation gives us at onc 
the nature of intelligence as the tests test it. 
telligence test exists at present which em 
mental operation. Most tests for intelligen 

. consist of batteries of single tests, 


е some insight into 
No satisfactory in- 
ploys a single type of 
ce, like the army tests, 
i t every one of which appears, 
on inspection, to test some special ability, like arithmetical 


ability, or an appreciation of verbal relations or of logical rela- 
tions. When one obtains the correlations among the different 
tests that make up the battery called an intelligence test, one 
finds that the separate tests do not correlate with one another so 
very highly—not so highly as a rule as does one combined intel- 
ligence test with another. These results are explained by saying 
that the separate tests are really tests of Separate abilities, and that 
each of these abilities involves, in part, intelligence, which is a 
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factor common to all the tests, and in part a special ability, 
which is not intelligence and which therefore explains the failure 
of the tests to correlate very highly. When the separate tests are 
combined in a total score, the special abilities, being unrelated, 
are supposed to cancel out, leaving the score to represent the 
"common factor," intelligence. 

Thus we see that there is no such thing as a test for pure in- 
telligence. Intelligence is not demonstrable except in connection 
with some special ability. It would never have been thought of 
as a separate entity had it not seemed that very different mental 
abilities had something in common, a “common factor.” 


A. CONFUSION OF MEANINGS 


One of the most frequent reasons for the misunderstanding of 
the tests is the fact that the existence and importance of these 
Special abilities are usually lost sight of. The psychologists them- 
Selves are very apt to forget them and it is no wonder that their 
lay audiences are scarcely aware of them. Yet it is not even pos- 
sible to understand the nature of tested intelligence without con- 
sidering them. They are forgotten in part because the “common 
factor” has seemed especially important and the interest of the 
testers in the last decade has centered in it. Words, however, 


have also helped to obscure their existence. The tested intelli- 


ence оѓ ап individual is often called his “mental age"; the in- 
Crease of intelligence in childhood is generally called “mental 
growth.” In this way psychologists have inadvertently equated 
the “intelligent” to the “mental,” overlooking in their terminology 
the vast number of special abilities that help to make up the 
“mind.” It is high time for a change of words here. The pres- 
ent usage requires us to say that the average adult has a “mental 
аре” of about fourteen and that “mental growth" on the average 
Stops at fourteen. Nothing could be more untrue. The statement 
сап be true only of intelligence as the tests test it. The special 
abilities, which make up skill and knowledge, continue to cumu- 
late presumably throughout all adult life. 

_ Avery useful conception of intelligence, and one that is арргох- 
Imately correct in the light of our present knowledge, is that in- 
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telligence is like "power" as the physicist uses the word: the 
amount of work that can be done in a given time. АП intelligence 
tests involve the maintenance of time-limits to some extent, and 
most tests are "speed" tests where all the work is performed | j 
against time. We may think, then, of intelligence as power and қ 
of а special ability as а machine that utilizes the power for a 

particular purpose. No machine can operate without power, and 
power is actually demonstrable only when it has a machine 
through which to operate. It is idle to speculate as to which is 
the more important, the power or the adaptive device for the 
utilization of the power; and it is folly to bet one's fortune on 
the power, forgetting the machine. 


Part П 


INTELLIGENCE AND 
2 LEARNING ABILITY 


The term "learning ability" is often loosely used as a synonym 
| for "intelligence." The fact that at all educational levels correla- 
tions between scores on intelligence tests and ratings of school 
achievement turn out to be fairly high seems to support such an 
interpretation. But a more careful analysis of the matter uncovers 
many complications. Both school records and intelligence-test 
scores are based on what the person has already learned in the 
years he has lived. Thus the correlations may simply reflect the 
fact that questions asked in intelligence tests, like questions asked 
in school, give an advantage to subjects who for one reason or 
another have learned the most. To prove that such tests measure 
the ability to learn, it is necessary to answer the question: Do 
test scores predict the amount individuals will learn or the im- | 
provement in performance they will show under standard condi- 
tions? i 

Besides pointing up an interesting theoretical issue, answers to " 
this question have important practical implications. The uncritical | 
assumption that intelligence tests measure general learning ability \ 
can lead to pessimistic prognoses for persons who score low and | 
unrealistic expectations for persons who score high. Neither of 
these attitudes facilitates the learning every individual must ac- 
complish if he is to contribute as much as he can to our complex | 
0210: 
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Intelligence and Improvement in 
School Subjects 


HERBERT WoopRow 


The first selection reports some significant studies by Herbert 
Woodrow, whose important work on the problem of learning 
ability has not always received the attention it deserves. This 
paper is an abridged version of "Intelligence and Improvement in 
School Subjects,” from the Journal of Educational Psychology, 
1945, 36, 155—166. It is reprinted with the permission of the 
American Psychological Association. 


In view of the vast number of studies which have been made 
of the intercorrelations of achievement scores in a given grade, it 
is surprising that so few have been devoted to intercorrelations 
Of measured improvements from one grade to the next. One 
reason for this neglect may be that the ability to improve has 
Often been assumed to be synonymous with intelligence. (7, 2, 3, 
4, 5) That little support for this view can be found in the gains 
made by grade-school pupils, over a period of a year or longer, 
15 obvious from the data presented below. Two recently com- 
pleted studies will be described. The results obtained suggest 
that prevailing concepts concerning the determining conditions 
of the gains made by school pupils are still іп need of consider- 
able development. 

Тһе measures of improvement used in each study were based 
Оп objective test-scores yielded by standardized achievement 
tests in the following six school skills or subject-matters: reading, 
vocabulary, arithmetic fundamentals, arithmetic problems, Eng- 
lish, and spelling. The average published reliability coefficient of 
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these part scores is .86.! The data have been studied particu- 
larly for their bearing on two questions: (1) whether the ability 
to improve is synonymous with intelligence, and (2) since the 
answer to the first question turns out to be negative, whether 
there is any general ability to improve, that is, any common fac- 
tor, intelligence or otherwise, manifested in the gains in the 
various school subjects. 

It should, of course, be kept in mind that the apparent de- 
termining condition of gains in school, that is, school attendance 
for a stated time in a given school class, although a more natural 
or life-like condition than practice conducted in a laboratory, is, 
in reality, a complex of variables which are not kept constant 
for all the pupils. Some variables which readily come to mind 
are irregularities in attendance at school, interest and liking for 
the subject, health, study habits, level of aspiration, various 
home influences, and a complex of conditions, not too well un- 
derstood, determining what is rather vaguely called motivation. 
In spite of the lack of experimental control of conditions in the 
school situation, it is interesting to observe that gains in various 
school subject-matters or skills, at least in the upper grades, show 
about the same lack of relation with each other and with intelli- 
gence as do the gains observed under better controll 
experiments on the effects of practice. (6, 7, 8, 9) 

The first study, carried out in the grammar grades of the small 
town of Litchfield, Illinois, deals with improvements occurring 
in one calendar year, in the case of pupils of the fourth, fifth, and 
sixth grades. Since none of the children repeated grades in this 
school, upon the second testing the fourth-grade children were 
in the fifth grade, the fifth-grade children in the sixth grade, and 
the sixth-grade children in the seventh grade. The Metropolitan 
Achievement Battery was given to all pupils on the same half- 
day in May of successive years, different forms being used each 
year. .. . Each of the gain scores used consists of the differ- 
ence between the two scores yielded by the Metropolitan Tests | 
on successive years. The index of intelligence used was an 
of scores obtained on two testings by the Otis Quick. 


led laboratory 


average 
-Scoring 
2 Metropolitan Achievement Tests, Supervisors Manual, World 


Book Co., 1939, p. 72 (Tests 1, 2, 3, 4, 5, and 9, grades IV-VII 
incl.). 
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Mental Ability Test, Form Alpha one year, and Form Beta the 
following year. 

Before giving the correlations between improvement scores, it 
may be well to refer briefly to the correlations of achievement 
Scores. These correlations were as large as, or perhaps larger 
than, those usually found. A few were over .80, and most оғ 
them were between .50 and .70. The average of the fifteen inter- 
correlations between the six achievement scores at each testing 
are shown in Table 1. The mean of all the correlations repre- 
sented in the table, numbering forty-five, is .60. 


TABLE 1 


Average Achievement Score Intercorrelation 


Group First testing Second testing 


М 
) 
5th grade .536 .626 М 
6th grade .656 .641 
7th grade .557 .557 


In spite of these very considerable correlations between 
achievement scores, the correlations between the gains occurring | 
in one year were very low indeed. These correlations are given in 
Table 2. Included also are the correlations shown by the separate _ 
Subject-matter gains with average IQ. Of the forty-five inter- 
Correlations between gain scores, only three are large enough 
to be significant by the criterion of three times their standard 
error. Of these three significant correlations, two were correla- 
tions between gain in arithmetic problems and gain in arithmetic | 
fundamentals, one of .468 in the fifth grade and one of .417 in | 
the sixth grade. Nine of the correlations were negative, and the 
average of the entire forty-five correlations was only .12, a figure 
which contrasts strongly with the average intercorrelation of .60. 
obtained between the test scores for any one date and grade. Cer- 
tainly the low average intercorrelation of .12 between the gains | 
lends no encouragement to the idea that these gains are deter- | 
mined to any important extent by one and the same general. 
ability to improve in mastery of school subjects during one year 
of study. 
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TABLE 2 
Intercorrelation of One-year Gains in Achievement 
RES V. AP AF E S CA 
У 1198 
АР 208 287 4th to 5th 
AF .148 347 468 Grade 
E .126 095 —.028 .071 (N — 94) 
S 212 1131 1168 261 .005 
СА —.267 —.321 —.213 -.250 061 —.316 
IQ 422 341 508 (432 —.065 395 —.675 
V 112 
АР -119 229 5th to 6th 
AF .043 .210 417 Grade 
E 115 035 (052 —.039 (М = 96) 
5 —.032 192 .005 224 —.106 
СА —.202 —.257 —.180 —.40 -.009 —.092 
IQ  —.001 .233 306 (273 --127 264 —.720 
У 1183 
АР 177 —.022 6th to 7th 
AF 156 .092 193 Grade 
E 156 —.024 150 —.107 (N — 102) 
5 080 216 064 134 —.112 
СА -162 —.073 —.062 —.015 -165 -17%- 
10 169 1124 076 (012 — 


(0208: 2950 1754) 


The abbreviations represent the one-year gains іп scores, as follows: R, 
reading; V, vocabulary; AP, arithmetic problems; AF, arithmetic funda- 
mentals; E, English; S, spelling. CA stands for chronological age and IQ 
for the average IQ of the first and second testings, 


The conclusion reached by direct examination of the inter- 
correlations of the gains was confirmed and extended by means 
of factor analyses carried out separately with the intercorrelations 
of each grade, by means of the centroid method, with rotation of 
axes. The rotation of the factors is admittedly a somewhat arbi- 
trary one and does not pretend to reveal what Thurstone calls 
primary abilities. Тһе results are shown in Table 3. 
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TABLE 3 
Correlations of Gains with Rotated Orthogonal Factors 


I П ш IV m 
Fifth-grade Group 
R 440 —.024 278 —.029 ‚2723 
V 347 374 213 084 3127 
АР 433 449 —.013 —.034 .3904 
AF 368 546 .079 .288 .5227 4 
E —.068 017 435 105 .2052 
5 433 .002 .050 229 2424 | 
СА —.707 —.072 —.001 205 5469 
10 933 219 —.107 -413% 9484 
Sixth-grade Group 
R 050 -.091 421 105 1900 
Vi 130 341 199 322 2765 
АР 1165 541 076 —.042 .3264 
AF .166 .683 .002 .028 .4949 
Е —.107 .009 321 —.080 .1209 4 
5 07 487 —.132 261 11319 | 
СА —.856 1062 334 095 .8571 
IQ .800 .259 —.150 324 8346 
Seventh-grade Group | 
R 451 1129 482 263 3400 7) 
M 421 001 059 425 .1987 
АР 039 304 240 .001 1515 
TE —.030 489 050 153 2659 
Е 036 —.120 381 —.099 .1707 
5 255 477 —.100 408 .2728 ( 
СА —.936 —.028 1124 - 103 9099 |: 
IQ .825 425 .004 047 .6984 | 
12, the sum of the squares of the four factor loadings, is the proportion | 
Of the total variance of a gain accounted for by the four common factors. 1 
In the two higher grades, the conclusion that there was no | 
general learning factor at all in the one-year gains is established | 


to a high degree of certainty. In the lowest grade, that is, for il 
the gains made from the fourth to the fifth. grade, all gains but К 
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| one showed positive correlations or “loadings,” varying from .35 
1 _ to .44, with the same factor. Only the gain in English showed 
^ no positive correlation with his factor (the correlation in this 
case being —.068). The lack of correlation of gains in English 
М With this factor, in the fifth-grade group, is verified by the very 
= low correlation of these gains with those in arithmetic funda- 
mentals and arithmetic problems, .071 and —.028, respectively. 
_ Of course, it is possible that some special local conditions ac- 
_ counted for the low correlations shown by the English gains; and 
_ the fact that all other gains showed a positive correlation with 
һе common factor, suggests the possibility that in the primary 
grades all gains in particular achievement tests might, as a rule, 
n Show a significant correlation with one general factor. This fac- 
. tor, which in the fifth-grade group was a general factor except 
for English, correlated .933 with IQ, and could, therefore, pre- 
. sumably be identified as largely the same thing as intelligence as 
measured by the Otis Tests. 

In the two higher grades, also, there was revealed an intelli- 
gence factor, i.e., a factor Which correlated highly with IQ. For 
— grades VI and VII, the correlations of this factor with IQ were 

-800 and .825, respectively. In these grades, however, the согге- 
lations between (һе gain scores and this intelligence factor varied 
, around zero (from .255 to —.107), and none of them can be 
considered Statistically significant. For the sixth grade, they 
averaged .085; and for the Seventh, .095. In these two grades, 
then, the gains may be said to show no general intelligence 
factor. d 

Besides the IQ factor, two, and perhaps three, other factors 
were found. One of these (factor II in Table 3) was a factor 
common to the two arithmetical gains, those in arithmetic funda- 

mentals and in arithmetic problems. These two gains had a 
considerable loading with this factor in all grades, and in the 
- fifth and sixth grades vocabulary gain also correlated with this 
factor to a degree possibly significant (.374 in Grade V and 341 ' 
in Grade VI). 

A third factor (factor III in Table 3) had to do with gain in 
verbal performances, particularly reading and English. This 
factor showed correlation with gains in reading of .278, .421, 
and .482 in the fifth, sixth, and seventh grades, respectively. With 


T 
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gains in English, it showed correlations of .435, .321 and .381. 
The variation in the loadings of these verbal tests in the differ- | 
ent grades may possibly be attributed to differences in course 
content and teaching. On the other hand, it may well be sup- 
posed that the nature of the factor itself varied somewhat with — 
the correlational matrix from which it was extracted. In no - 
grade, however, does this factor have any marked relation ТОШ 
Otis IQ; and it is, of course, since the extracted factors were | 
uncorrelated, entirely unrelated to the chief factor in Otis IQ, - 
that is, to factor I. In the case of the first two factors, it is quite М 
certain that much the same factor is involved in all grades, (һе 1 
first of these two factors being identifiable by its very high cor- - 
relations with IQ and the second by the fact that the two sorts | 
of arithmetical gain are always definitely correlated with it. | 
Only in the case of these two factors is it possible to postulate an. 
approximate identity in the case of the different grades. A fourth 
factor was extracted, but its significance is slight and it appears | 
very doubtful that it has the same interpretation in the case of - 
the different grades. D 
Lastly, attention should be called to the fact that even when 
the four common factors extracted are all taken together, they | 
account for only a part of the total variance in the gain scores. 
This is shown by the columns headed “h?,” the proportions listed 
іп which may be interpreted as the sum of the variances pro- | 
duced by the four uncorrelated factors; and, further, if the total 
variance in any one gain is taken as 1.0, these proportions also 
Tepresent the proportions of the total variances of the various. 
Bains accounted for by the joint effect of the common factors. 
Now these proportions averaged as follows: fifth-grade group, 
:324; sixth-grade group, .258; and seventh-grade group .233. 
The conclusion is indicated that by far the larger part of thi 
Variance in gains is due either to errors of measurement in the 
gains or to specific factors, that is, factors varying from gain | 
to gain and not common to the gains іп any two subject-matters. 
In all probability both errors of measurement (sometimes called 
errors of response), and specific factors are important causes of 
the gain variances. The relative importance of these two causes, 
however, cannot be specified because of lack of knowledge of. thi 
reliability of the gain scores. It is not possible even to state the 
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reliability of the single scores, since it would be unsafe to assume 
this reliability to be the same as the published reliabilities (av- 
eraging .86). One might guess the average reliability of the single 
tests to be about .80, and the reliability of the Bains to average 
somewhere between .40 and .50. If the gains have an average 
reliability of .40, which is certainly a very conservative estimate, 
it would still follow that specific factors were, roughly and on 
the average, about half as important (that is, contribute about 
half as much to the total variance of the gains) as all four of 
_ the group factors taken together. 
In general, then, results of this study may be summarized as 
follows: 
1) No gain factor was found in the case of any grade which 
had to do with gain in all six of the subject-matters, 
2) Instead, the intercorrelations revealed three group factors: 
Т. A factor which was exceedingly important in determining IQ 
intelligence; II, a factor common 
arithmetic problems; and ПІ, a 
scores in reading and English. 
determining Otis IQ, had prac- 
n any of the school subjects in 


gains as measured were unique, that 
y one.of the common factors nor to all of 
them taken together, but to a combination of errors of measure- 
ment and the specific factors. It is probable that gain in each sub- 
ject depended at least half as much upon its own specific factor 

аз upon all the common factors taken together... , a 
[The omitted portion deals with а briefer report of a study in 
Providence, Rhode Island, in which very similar results were ob- 

_ tained.] 

In general 
Providence d 


Ore at any given time 
n between intelligence 


INTELLIGENCE AND SCHOOL SUBJECTS 39 


and ability to learn is identical with the correlation between in- 
telligence and achievement score at a given time. This correla- 
tion is a pronounced one, particularly if corrected for attenua- 
tion. It is significant, however, that the correlation between 
intelligence and achievement reaches its maximum rather early 
in the school grades. This is not what one would expect if gains 
depended mainly on intelligence. One might then reasonably ex- 
pect correlation with intelligence to show a marked increase 
in the higher grades as compared with the lower grades. While, 
then, the present data do not disprove the allegation that intelli- 
gence may be the chief determiner of how much the individual 
has learned in the past (measured from zero), they strongly indi- 
cate that intelligence cannot be postulated generally and without 
qualification to be the chief determiner of how much the pupil 
will learn in the future. If the first measurements of intelligence 
and achievement are made beyond the fifth grade, the indications 
are that intelligence, far from being the principal factor, is а 
rather minor factor in accounting for individual differences in 
improvement in any specified number of additional years. More- 


Over, in such a case there is no evidence of any other general A 


factor, that is, a general unitary learning ability other than intelli- 


gence possessing an all-pervading importance as a determiner of | 


future gains. Instead, amount of future gain seems (for reasons 
which the present study does not divulge) to correlate chiefly 
with quasi-general and specific factors, the former varying from 
One group of subject-matters to another and the latter from one 
subject-matter to any different one. 
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Intelligence Test Scores as Indicative 
of Ability to Learn 

Я 
J. W. TILTON | 


Four years after the Woodrow report appeared, J. W. Tilton | 
raised some serious questions about its conclusions, and presented 
evidence of his own that under some circumstances, which he 4 
Specified, intelligence tests do indeed correlate with gains in 
school achievement. The decisive factor seems to be the inclu- | 
sion in the achievement tests of enough difficult items so that the 
bright pupil can demonstrate what he has gained. The Tilton | 
paper, entitled "Intelligence Test Scores as Indicative of Ability | 
to Learn," appeared in Educational and Psychological Measure- ` 
ment, 1949, 9, 291—296. It is reprinted with the permission of 
the author and Educational and Psychological Measurement. 


INTRODUCTION ү 


If one starts with the assumption that the most dependable | 
measure of learning is secured by subtracting a measure of 
Status before from one after the period of practice, study or in- 
Struction, he finds himself in an arresting situation with regard. 
to the definition of intelligence as the ability to learn. This is so 
because measured changes in score tend to be negligibly cor- 
related. with intelligence-test scores (2). What then shall we 
Say about the validity of the use of intelligence-test scores 
Schools, and elsewhere, as indices of the ability to learn? Mu 
We conclude from this reported negligible correlation, in spit 
of a long period of use for that purpose, that intelligence-test 
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Scores are not indicative of the ability to learn? The position 
taken in this paper is not a categorical yes or no. The paper is 
not a full consideration of the topic. The emphasis in the paper 
is that the measures of learning which have provided the low 

. correlation are not an adequate basis upon which to claim in- 
validation. 


% 


2 


What are the qualifications for measures of gain, if they are 


DEFINITION OF AN ADEQUATE CRITERION 


. to constitute a criterion for the validation of intelligence-test 

_ Scores as indices of the ability to learn? 

. First, the reliability of the measures of gain must be known, 
and should be as high as that for end-scores. This seems like a 
trite observation, but it seems to be needed. The tendency is to 
be satisfied with having used end-tests of acceptable reliability, 

| and to let it go at that. To use reliable end-test scores is good, so 

n as it goes, but it is not enough. Even with the coefficient of 
reliability for the end-tests as high as .95, the reliability of the 
difference may be zero. The end-tests contribute only unrelia- 

. bility to the measures of differences, АП you can say for reliable 

end-tests, is that the more reliable the end-tests, the less handicap 

there is to be overcome in the measurement of gains. How re- 
liable the differences are depends chiefly upon what happens to 
change the pupils between testings. In other words, since reli- 
ability is the ratio of true variance to obtained variance, the reli- 
ability of gains is a positive function of the differentiation, which 
learning introduces, and a negative function of error in measure- 
ment. 
The trouble in practice is that we do not wait for learning to 
introduce enough differentiation. We think we are doing well if 
we allow a whole school year to elapse between the initial and 
final tests. But even after a year, reliabilities of gains, for in- 
stance, on the parts of achievement-test batteries, are still low. 

Whatever the reliability is, it needs to be measured and reported. 
Without such information most measures of gain may be assumed 
to be very unreliable, and to show very low correlations with in- 
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telligence-test scores, or with any other independent measure, 3 
merely because of that unreliability.* я 
But for the measures of gain to be sufficiently reliable, or at 
least of known reliability, is not enough. A second requirement 
must be set up. If the measures of learning are to be used as a | 
criterion, against which intelligence-test or other scores are to 
be validated, as measures of the ability to learn, something must 
be required of the learning situation. It must provide an oppor- 
. tunity for each to learn according to his ability. 
Data with regard to spelling, reported by Carroll (1), illustrate 
a situation in which such an opportunity does not exist. At the 
beginning of the year pupils were tested as to their ability to spell 
the words to be taught during the year. Had they been tested | 
again at the end of the year, the brighter pupils could not have | 
made the larger gains, assuming 100 per cent mastery, because | 
they knew 81 per cent of the words at the beginning of the year | 
whereas the duller pupils could spell only 40 per cent of them, | 
The bright could gain only from 81 to 100 from the situation, | 
while the dull could gain from 40 to 100. 
Gains obtained under such circumstances, where there are | 
clear limitations of opportunity, are obviously not suitable as cri- | 
teria of the ability to learn. It is quite possible that such limits аге _ 
often present in the school situation; limited offering, because of | 
the tendency to organize content into years and semesters, limited 
instructional help because of the pressure upon teachers to get | 
about 95 per cent of the class above the required standard. At 
any rate, not all measures.of gain are suitable to serve as criteria, - 
even if satisfactory so far as reliability is concerned. Intelligence- 
test or other scores may not be invalidated as indices of the abil- | 
ity to learn in situations in which the possibility of validation ds. 
curtailed. vn 
Іп the third place, and finally, the possibility of validation must 
be uncurtailed not only in the teaching or learning situation, but 
also in the testing situation. It is not enough that each has the | 
opportunity to learn according to his ability, he must also have | 


+ Those not familiar with the substantial correlation which may be 

. Obtained between initial or final test and gain (5) merely because of 
the correlation of errors are probably led erroneously to infer relia- 
bility from such correlations. 2464 
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in the measure of gain. 


r an opportunity for the full amount of that learning to be reflected 
| Неге again, as in the cas 


(ranging in difficulty 
- from 0.to 100 through a central tendency of 50 per cent) it will 
measures of learning. 
ing is to be obtained, 


blis ns, the reliability has 
› It is not known to what extent the oppor- 
| tunity to learn was curtailed, and, if the Opportunity to learn 
was adequate, it is not known Whether the tests permitted good 
. measures of the learning. If the validity of status Scores, as indices 
of the ability to learn, is to be checked, data are needed, and 
_ they need to be chosen specifically for that purpose. 


TWO ATTEMPTS TO SECURE 
AN ADEQUATE CRITERION 


There were, in the writer's files, two Sets of data which it was 
thought might yield satisfactory criterion-measures of learning.? 
* The seventh-grade data have been described by D. C. Knowlton 


and J. W. Tilton (3). For the twelfth-grade data, the writer is in- 
debted to Clarence H. Elliott. 


| 
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Both were in the social studies area, one at the seventh-grade level $ 
and one at the twelfth. The data to be reported here for the. 

seventh grade are for a sample. The sample is composed of all. 

cases with a full set of scores from 6 of the 9 control sections in 
an experiment. For the whole grade in the single junior high 
School, (N — 515), the mean Otis Group IQ was 100.0, the | 
sigma was 22.2. For the sample (N — 134), the mean and sigma 
were 102.9 and 23.1. The sample is therefore fairly representative 
of the whole seventh grade. The data to be reported for the 

Бат grade are for the full twelfth grade іп one high school, р 

= 156. 

ho tests in the seventh grade were made for four? experi- | 
mental units of instruction. They were composed of 300 WE 
and covered eleven weeks of instruction. The twelfth-grade test. 
was the Columbia Research Bureau American History Test, com- 
posed of 200 items. The period covered was one school year. 

In each case most of the items were discarded. What was 
wanted, as stated above, was to be sure of differentiation as to 
learning with the least curtailment of opportunity. The choices. 
Were arbitrary. First, it was assumed that when fewer students | 
answered an item correctly at the end of the period than at the 
beginning, the loss was a chance difference. Then all items were 
discarded unless the gain was larger than the largest loss. Second, и 
it was assumed that if the abler students were being penalized | 
in the full test, it was by the presence of items answered correctly - 
at the beginning by a majority of the students. Arbitrarily, fo 
the seventh grade, items were discarded which initially were 
Swered correctly by more than 45 per cent. For the twelfth. 
grade, for which a greater caution seemed advisable, all items 
were discarded if answered correctly by more than 25 per cen 
at the beginning of the year. 

There remained for criterion tests of learning, 54 items for a 
Seventh-grade sample, and 20 items for the twelfth grade. The 54 
items ranged in learning difliculty from 7 to 83 per cent, aver- 
aging 34 per cent. The 20 items ranged from 18 to 58 per cent, 
with an average of 38 per cent. The reliability coefficients are 
-93 and .73. 


t 


* Units 1, 3, 4, and 5. Unit 2 was discarded for the present ршр‹ 
because of the relatively small gains made (3) Table 4, p. 42. 
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. THE USE OF CRITERION SCORES 


— How well should intelligence-test scores agree with criterion 
. measures of learning? What “passing mark" may be set, above 
- which validity may be said to have been established? It is easy 
Ее. to agree that if the correlation is zero, validity has not 
| been established. But is it reasonable to require the correlation 
to approach unity? There are two reasons why that would be 
. unreasonable. One is that the factors of interest and application 
_ are unaccounted for. The other is specialization of ability. It has 
. hot been assumed that intelligence-test scores are equally indic- 
_ ative of learning in all areas, A reasonable requirement is that 
the agreement between index and criterion should approximate 
‘that between the index and initial status in the area of the 
criterion learning. 
—. This Iequirement is met in the seventh-grade sample and іп the 
twelfth grade. The correlations for the seventh-grade Otis IQ are 
with initial .50 and with the learning criterion .49, For the 


twelfth-grade Terman Group 10%, the correlations are with initial 
:43 and with the learning criterion .49,4 


=| 
| DISCUSSION 


As it turned out, in these two cases the construction of criterion 

measures with selected items was in a sense a wasted effort. The 
correlations of IQ with gains using all items were not reliably less 
than with the criterion measures. In other words, the gains on all 
items were proved to be good criterion measures, as they were— 

. fairly reliable (.72 and .68), and obtained in a situation in which 
there was plenty of opportunity both to learn and to be measured, 
The criterion measures gave evidence of Superiority only with 
respect to reliability, .93 for 54 items as compared with .72 for 
all 300 items, and .73 for 20 items, as compared with .68 for 
all of the 200 items. 


EXC: i t alter the picture much. In 
* Correction for attenuation does no р 

Же the reliability of the Otis IQ was estimated, the other 

reliabilities were computed. The four corrected correlations in the 

order mentioned above are: .58, .53, .56, and .58. 
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CONCLUSION 


It may be said that within the two sets of data described, in- 


telligence-test scores predicted learning fairly well. But this paper | 


has been presented, not so much for the weight of the evidence 
presented, as to serve as a stimulus to similar reports, a plea for. 
better data than are available. In hundreds of experiments, in- 
telligence-test scores have been used in equating groups. The | 
correlation between these scores and gains should be reported, 

with measures (or good estimates) of the extent to which the 

Bains are suitable criteria. If intelligence-test scores are to be 
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discredited as indices of the ability to learn, it must be done | 


with more concern for defensible criteria than has been given 
to the problem. 
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Studies in Concept Attainment: Effect of 
. Instruction at Two Levels of Intelligence 


S. Е. OSLER AND 5. R. Weiss €; 


Tilton's results pointed up the fact that the relationship be- 
tween intelligence and learning ability depends in some way on 
the difficulty of the material to be learned. On achievement tests 


ent of concepts, 
produced evidence 
report included in this 


› is entitled “Studies in 
Concept Attainment: III. Effect of Instructions at Two Levels of 


Intelligence,” Journal of Experimental Psychology, 1962, 63, рр. 
528—533. It is reprinted with the permission of the author and 
the American Psychological Association. 


Іп a recent study on the effect of intelligence on concept attain- 
ment using instructions which were nonspecific as to the nature 
of the task, Osler and Fivel (1961) reported a significant dif- 
ference in errors between groups of average and superior IQ. 
An important question that has yet to be answered concerns the 
pertinent attribute of high intelligence which accounts for the 
superiority of performance. One possibility is that superior Ss | 
supplement E's instructions with their own, directing them to 
search for consistencies in the reinforced stimuli; whereas the less 
intelligent 5s work along without self-instructions until the rein- 
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forcement contingencies of the experiment strengthen the re- | 
sponse to the concept exemplars. Perhaps a simpler statement of 
this hypothesis might be that under the conditions of nonspecific 
instructions the task presented to 5 has two components, namely, 
problem finding as well as problem solving; and that the superior | 
performance associated with high intelligence may be the result. 
of greater proficiency at either or both of these components. On. 
the other hand, when instructions are specific, defining the prob- | 
lem which 5 is expected to solve, the problem finding component | 
of the task is eliminated or reduced to a minimum. E 

It was the aim of the present investigation to test these ideas. 
experimentally. Two experiments were performed. Experiment I 
was a replication of the Osler and Fivel (1961) experiment. | 
This was undertaken for the double purpose of confirming the 
earlier data and controlling for the possibility that automated | 
equipment presently being used for the conduct of the experi- 
ment may have affected the results obtained. In Exp. II the 
general instructions were replaced by more specific ones, defining 
the problem for S and directing him to search for hypotheses. 


METHOD 


As Exp. I and II differed only in the instructions used, th 
method for both will be described together, and wherever nece: 
sary information pertinent to each experiment will be provi 
Separately. 


Subjects 


The Ss consisted of 180 school children attending elementary 
and junior high schools of Baltimore City and County, equally 
divided among the following age groups: 6, 10, and 14 yr. Each 
S was within 6 mo. of the age specified. Half of the Ss within 
each age level had a WISC IQ between 90 and 109 (Average In- 
telligence group), and the other half had a WISC IQ of 110 and 
above (High Intelligence group). The mean IQs of the two. 
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groups in Exp. I were 100.8 and 120.9, and in Exp. II they were 
101.2 and 121.7 respectively. 


Apparatus 


The apparatus has been described elsewhere (Osler & Powell, 
1960). Essentially, it consisted of a film strip projector and a 
screen to receive the projected images of the stimuli which ap- 
peared in pairs. A telegraph key placed under each stimulus re- 
leased a marble following a correct response, which consisted of 
pressing the key under the concept exemplar. No reinforcement 
followed if the key under the negative stimulus was pressed. The 
Ss were not paced, but 4 sec, after a response was made the next 
stimulus was presented. 
The concept studied was bird. This was one of the three con- 
cepts on which data were reported by Osler and Fivel (1961). 
_ The stimuli used were the same as in the previous investigation, 

except that they now appeared on a screen projected from a film 
strip. The complete set of stimuli consisted of 150 pairs of pic- 
tures, one member of each pair Tepresenting a positive instance 


‘ 


of the concept and other a negative instance. The pictures of each 
pair were matched approximately in area, color, and brightness. 
Reasons for using naturalistic stimuli, which carry with them the 
hazard of unspecified dimensions, have been discussed elsewhere 
(Osler & Fivel, 1961). An additional reason prompting their use 
in this investigation was the previous finding that performance on 
this concept was a function of intelligence, thus demonstrating 
the suitability of this problem for the present study. The stimuli 

had been pretested on а group of children of the same age and 
intelligence levels as the present Ss, and were found to be fa- 
miliar to the type of subject studied. 


| Procedure 


Each 5 was tested individually, in two separate sessions. At the 
first session S was told that he would play a game in which he 
could win any one of a group of toys displayed before him. He 
was asked to select the most preferred of the group, and this was 
then set slightly apart from the others in a position which allowed 
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S to view it during the "game." The Ss in Exp. I received the 
following instructions: 


This is the game we are going to play. Here are two handles (E 
points to them). If you push the correct handle you will get a mar- 
ble. Sometimes this will be the correct handle and sometimes this 
Will be the correct handle. If you push the correct handle you will 
Bet à marble like this (demonstrated). If you push the wrong handle, 
like this, no marble will come (demonstrated). If you get a mar- 
ble you can put it here (here E points to а grooved wooden tray 
With which S was provided). Now you try this one and let's see 
What happens. If you look at these pictures before pushing the han- 
dle you will be able to get many marbles. When you fill the tray 
with marbles, you can have the (name of the toy). 


The stimuli used during the demonstrations were unrelated to 
the concept. 

In Exp. II the Ss were also informed about a game in which 
they could win a toy, and then they received the following in- 
Structions: 


This is the game we're going to play. Listen carefully and І will 
tell you how to play the game. Here are two pictures. You pick one 
Of them and push the handle under it, and if you are right, you will 
Bet a marble, like this (demonstrated). If you аге wrong you will 
ПОЕ get a marble, like this (demonstrated). Now you try and push 
this one. The game is to see how soon you can get a marble every 
time you choose. If you look at the picture carefully you will see 
that there is something in the pictures like an idea that will tell you 
Which one to choose to get a marble every time. Now we will start 
the real game. What are you going to do first? (if S does not say: 
look at the pictures, E supplies the answer). If you look carefully 
and see which pictures give you the marble you will be able to win 


Marbles every time. Are you ready? Remember, look at the pictures 

first. (The A ther with the follow- 

{ ag reced was repeated toge 
quete Wo ber, there is an idea that 


ae Sentence whenever necessary.) Remem 
ill tell you which picture will give you the marble. 


The procedure was continued until 5 made 10 consecutively 
Correct responses, which was the criterion of success. At this 
Point E commented on 57% good work and asked him how he 


d 
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knew where the marble was each time. If S could not state the 
rule correctly the procedure was continued with questions fol- 
lowing each block of 10 consecutively correct responses until S 
gave a correct answer or completed 150 trials. Any S who did 
not achieve criterion performance at that point was considered 
to have failed. A second session, held within 2 weeks of the first, 
was devoted to the administration of the WISC. 


Experimental Design 


In both experiments a 3 x 2 factorial design was used with 
three ages and two intelligence levels constituting the respective 
variables. Thus there were six experimental groups with 15 Ss in 
each group, a total of 90 Ss in each experiment, 


RESULTS 


The results were analyzed in terms of three measures of per- 
formance: (a) the mean number of errors to criterion, (b) the 
number of Ss who attained the criterion, and (c) the number of 
Ss who verbalized the concept at the point of success. 


Experiment I 


The mean number of errors per group and the results of an 
analysis of variance,! presented in Table 1, indicate that age 
and intelligence were associated with reliable differences in per- 
formance, thus reproducing the findings reported by Osler and 
Fivel (1961). Similar results were obtained from an analysis 
of the data on frequency of Ss who attained criterion perform- 
ance and those who were able to verbalize the concept, as shown 


+ Among the 14-yr-old Ss the conditions necessary for application 
of an analysis of variance were not entirely satisfied because of skew- 
ness of the distribution and the smaller variance of the 14-yr-old High 
Intelligence group. For this age group the distribution of errors was 
examined and compared (by X^) for average and high intelligence 
within and between the two experiments. There was no evidence of 
significant differences among the 14-yr-old Ss according to intelligence 
or between the experiments. 
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TABLE 1 


Mean Number of Errors to a Criterion of 10 Consecutive 
Correct Responses with General Instructions 


Groups 
6-Yr. Ss 10-Yr. Ss 14-Yr. Ss 
I " Means | 
ntelligence Mea 5р Mean SD Mea SD by IQ 
Average IQ 712 210 389 34.5 143 222 415 
High 1Q 511 218 19.7 17.0 65 14 27.8 
Means by Age 64.2 29.3 10.4 


Мое Faen = 37.66, df = 2, P < .001; Fita. = 7.14, df = 1, P < .01; Faso x Intel. = <1. 


in Table 2. In summary, then, it turned out that with instructions 
that did not specify the nature of the task, age and intelligence 
Were associated with improved achievement in concept attain- 
ment on each of three measures of performance. 


Experiment II 


Table 3 presents the mean number of errors per group and 
the results of an analysis of variance of errors, respectively, for 

Хр. П. In this experiment, in which the nature of the task was 
explicitly defined, the effect of intelligence disappeared; only age 
Was associated with significant differences in the number of er- 
Tors. Similar results were obtained from an analysis of the other 
two measures of performance, number of Ss who achieved crite- 


TABLE 2 


Number of Ss Who Reached Criterion and Number Who 
Verbalized the Concept under General Instructions 


Groups 
i 6-Үг. Ss 10-Yr. Ss M-Yr. Ss All Ages 
—eligence Grit. Verb. Grit. Verb. Ой. Verb. Crit. Verb. 
Average I 2 
: Q 4 " $ 2 n 2B 25 16 
m i 7 4 4 u 15.514 E a 
= 11 5 22 13 202 бі. 45 
Ni PAR А 
af Criterion data: Age x? = 22.690, df= 2, P < .001; Intelligence x* = 6.156, 


x= T52“ 02. Verbalization data: Age x? = 33.068, df = 2, P < .001; Intelligenco | 
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ү TABLE 3 


Mean Number of Errors per Group for Reaching Criterion of 
10 Consecutive Correct Responses with Explicit Instructions 


Groups 
6-Yr. Ss 10-Yr. Ss 14-Yr. Ss "T. 
Intelligence Mean SD Mea SD Mean SD by IQ 
Average IQ 461 255 342 265 мл 174 31.5 
High IQ 465 340 310 313 7л 17.4 30.4 
/— Means by Age 46.3 35.6 10.9 


Note. — Fage = 13.52, df = 2, P <.001; Fist. < 1; Fagextat. < 1. 


. rion performance and number of Ss who verbalized the concept, 
_ as shown in Table 4. 


Combined Data from the Two Experiments 


In view of the comparable variances obtained in both. experi- 
ments the error data were combined and analyzed for a possible 

. Instructions X S interaction. The results of this analysis, pre- 
sented in Table 5, show that while instructions produced no main 


_ effect on performance, the Age X Instruction interaction was sig- 


nificant at the .05 level, When the data were subsequently ana- 


lyzed separately for each age group, it turned out that only for 
the 6-yr. Ss did instructions produce a significant difference in 
performance (F = 5.92, df = 1.59, P < .05) in favor of explicit- 


TABLE 4 


Number of Ss Who Reached Criterion and Number Who 
Verbalized the Concept under Explicit Instructions 


Groups 
6-Yr. Ss 10-Үг. Ss 14-Yr. Ss АП Ages 
Intelligence Crit. Verb. Crit. Verb. Crit. Verb. Crit. Verb. 
Average IO T 6 12 8 СЕТУ 37 26 
| High IQ 9 4 9, 3: 14 14 32 27 
Total > 20 10 ET 17 28 26 69 53 


Note.— Criterion data: Age x? = 7.081, df = 2, P < .05; Intelli 
ns. Verbalization data: Age x? = 17.715, df = 2, P < .001; Intel 
ns. 


gence x? = 1,552, df= 1, 
lligence x? = ,046, df = 1, 
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TABLE 5 
Analysis of Variance of Errors for Exp. I and П Combined 


Source df MS F 

Instructions (I) 1 616.05 
Age (A) 2 29,819.62 45.05** 
Intelligence (IQ) 1 2,456.81 3.71 
IXA 2 2,382.52 3.60* 
I XIQ 1 1,798.67 2.72 
A X IQ 2 7.90 
IXA xIQ 2 407.87 
Within 168 661.89 
"Total 179 

EP 05. 

** P < 001. 


ness, Another finding, rather surprising, and one difficult to ex- 
Plain, was that the bright 10-yr. Ss were handicapped by the 
explicit instructions. The mean number of errors for these Ss un- 
der the two conditions was 19.7 and 37.0, respectively (t = 2.57, 
df = 28, P < 002). The oldest group, the 14-yr. Ss, performed 
identically under both conditions. However, as is apparent from 
their scores, these Ss performed near the maximum possible 
level, and, therefore, could not be expected to show improvement 
under апу conditions. 

he analysis of the combined frequency data of successful Ss 
Shows that aside from age, reliable differences were produced by 
structions in the Average Intelligence but not in the High In- 
telligence group. The same results were yielded by the data on 
Correct. verbalization. 

Rank-order correlations were computed between error scores 
and MAs in each experiment. The rho values obtained were —.68 
Under general instructions and —.51 under explicit instructions. 

9th values are significant at the .001 level. Since the MA is 

ĉavily determined by the CA, the value of the correlation per se 
Оез not throw light upon the role of the IQ alone. However, as 
` in both experiments were identical in age and intelligence, the 


EN EPT 


be 14 y 4 n ші 


56 INTELLIGENCE 


difference between the two values of rho may be attributed to 
variations in experimental conditions. Unfortunately, no statistical 
test exists for evaluating the difference between the rho values; ` 
therefore all that can be said is that the direction of the difference 
is consistent with the other findings. 


DISCUSSION 


Under general instructions high intelligence was associated 
with superior achievement in all three measures of performance; 
but this superiority was not maintained under explicit instruc- 
tions. If the assumption that specific instructions eliminate the 
problem-finding component from the task is correct, then the 
conclusion to be drawn is that high intelligence gave 8 an ad- 
vantage in problem definition but not in problem solution in the 
concept attainment task. It is entirely possible, however, that were 
the concept task one of greater difficulty, intelligence might also 
prove to be advantageous in the solution phase of the task. This 
requires further investigation. F 

Since age was. associated with more effective concept attain- 

телі on all three measures of performance and under both types 
of instructions, it may be concluded that maturation involves 
growth in problem solving ability at least until some point be- 
tween 10 and 14 yr. 

In order to assess changes in problem finding ability as a func- 
tion of age, it is necessary to compare performance at each age 
level under the two types of instructions. That 6-yr. Ss improved 
under the explicit instructions is apparent from the significant 
Age X Instruction interaction in Table 5. The situation was not 
clear for the 10-yr. Ss because they actually deteriorated under 
explicit instructions. As this finding seemed to be inexplicable 
on any logical basis and was inconsistent with the results pertain- 
ing to the other two age groups, it was decided to replicate this 
portion of Exp. II. Upon replication it turned out that the aver- 
age 10-yr. Ss profited from the explicit instructions, while the 
superior Ss, were unaffected. As to the 14-уг. 58, whose per- 
formance was the same under both conditions, they did not have 
much room for improvement, precluding the possibility of reach- 
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Еш» conclusion on the effect of instructions at this age. 
ae E se that at least between 6 and 10 yr. Ss benefited 
Bud De qun of instructions. ]t is therefore reasonable to 
| M DA the more effective performance associated with in- 
| DE E bu pis brought about by improvement in problem 
p Bible i er by more effective problem solving. This points 
| Es 3 interesting difference between mental age and in- 
| ive » the effectiveness of the latter being due to more ef- 
i e problem finding rather than problem solving. 


SUMM ARY 
A Қ 
Ein attainment task was presented under general and 
о. ошен» {о 58 6, 10, апа 14 уг. of age, divided into 
2 three m igence groups. The results were analyzed in terms of 
9f succ easures: errors, number of Ss who achieved the criterion 
22 Tectly, ess, and number of Ss who verbalized the concept cor- 
y Un um 
E cur. a nonspecific instructions superior intellig 
| Of perf, ith more effective concept attainment on t 
ic but under explicit instructions Ss 
н unchange improved while those of superior intellige 
i tage in A Apparently, superior intelligence gave 
| probi he problem finding phase of the task, but 
rf P jx solution. 
ы 5 : 
rformance improved throughout the ag? range studied. 
4 


ег d "n egs, 
е was no evidence for improved problem finding ability be- 
difficult to evaluate the data 


fore, that problem solving 
increases within 


ence Was asso- 
hree measures 
of average in- 
nce remained 
Ss an advan- 
not in actual 


‘We 

for Tae and 10 yr., and it was 

ability, but yr.-olds. It appears, there 

.. he ape probably not problem finding ability, 

; Ее range studied. 
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Cognitive, Conative, and 
Non-Intellective Intelligence 
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M DAVID WECHSLER 

й 

ji 

j One of the issues that has divided theorists since the early days | 


Е етсе testing is whether or not the cognitive and non- 
EIN MR of individual differences can really be separated. 
è achieverne CES that both kinds of factors enter into every a 
tradition NARRA eee Ue in life. But we have a long historical | 
сор / istinguishing between two aspects of human nature, 
I nan eason and emotion, ability and motivation, ego and id. 1 
tion Бе z psychologists it has seemed important that this distinc- | 
итап TU ly maintained in the construction of tests to evaluate. К 
rtifciat laracteristics, Others have held that the distinction isan | 
testers e impossible to apply in practice, and that intelligence. ! 
ос AM оша frankly admit that motivation and personality 
Eh Шет A istics are an ineradicable feature of every “mental meas- 
ет.” D 


Шу in schools, | 
it makes а. 


Қ u 
ts and children i 


are ; 
logists concerned with the | 


" и tools used by all psycholo 
Tat inter; of intellectual level, has insisted tr s 
терні o and temperament cannot be divorced. The paper | 
i Торп here is a comprehensive statement of his position, — 
АТ ve, Сопайуе, апа Non-Intellective Intelligence," Ameri- | 


М t 
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can Psychologist, 1950, 5, рр. 78-83. It is reprinted with the реа 7 
mission of the author and the American Psychological Associa- 


tion. 


+ Г 
It is always а Bood omen for science when different men in 
different places make independent discoveries or arrive at similar 


From an historical Point of view, the first one to argue against | 
the identification of general intelligence with intellectual ability | 
was Henri Bergson. Already in his “Donées Immédiate de la ~ 
Conscience" and more emphatically in his *Evolütion Créatrice," 

. he pointed out the insufficiencies of the human intellect or, what 
was for him the Same, normative logic, in dealing effectively 


` With man's total environment. 


" reasoning, verbal, spatial, numerical, and a 


factors, all of which in Some particularized manner deal with 


claim that human intelligence, as the Psychologist conceives it, М 
can only deal with geometric and logical symbols? 


saying in our tests of intelligence, most of 


What is more important, it isn't true! Our contemporary defini- 
tions of intelligence assert as much: intelligence according to 
these is not only the ability to learn, to abstract, to profit from 


experience, but also to adjust and to achieve. 


INTELLIGENCE 


few other specified. 


this is what we are | 
us don't believe it. 


D 


Everyone with clini- | 
/ 
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Cal experi 

E. E ber, that the latter involve other capacities be- 

factors dum m А ‚ numerical, spatial, and the other intellective 

The салтын th een demonstrated. Yes, but what are they? 

traits Е деп еу are not intellective. They are capacities and 

Not restricted to es temperament and personaly Чу ЫШ ШЫ 

EE °° logical and abso pera дата aa 

independently oS pa itself. It is this point of view, 

Жо nonber We se or suggested, at times only tangentially, 

Wechsler E d investigators including Goldstein, Alexander, 

Presented. six 4. recently by Halstead and Eysenck, which I 

intellective E кыры the first time under the term Non- 

You more full = of Intelligence. I wish now to present to 

Appears to RA e evidence in its support and to justify what 

cept of general е only the need for a re-orientation in our соп- 

In. fact, Eis elligence, but of a new psychometric that will, 

Bence, € what is purported in our definition of intelli- 

Let А 

Psychometric’ by restating the issue in terms of the actual 

already ted problem. The crux of this problem, as we have 

Chologist does is the discrepancy between what the clinical psy- 

We examine еѕ and what he says he does in clinical practice. If 

We Shall ағым of the current psychological tests of intelligence, 

Шоп, а exist em to consist of sample tasks measuring, by defi- 

тагу of i of mental abilities. One would imagine that any 

ау а Tepo + results obtained with such tests would be essen- 
these тет үр the degree to which ап individual possesses 
ind p the manner in which they vary: However, it 

21715 whether ; at once a summative score 15 obtained from 

Chologist er in terms of MA, IQ, or whatnot, the clinical psy- 

Pecific Proceeds to enlarge his summary to include not only 

СЕ {согор interpretations but broad social and biologi- 
n IQ Nos as well. 

Mower thus used, not only to determine c 
'Sabilities " Capacity to learn, presence of sp 
So as a p, 400 evaluation of degree of ment 

Chiat 4515 for school placement, for vocational 


comparative mental 
ecial abilities and 
al deficiency, but 
guidance, for 


5 
сә latric а; t 5 
атар іп diagnosis, and for the prediction of adjustment po- 
udi Variety of situations from infancy to old аре, in- 
fit- 


Ing su 
Ch areas as child adoption, juvenile delinquency, 
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ness for military service, college success, and old age counseling. 

Assuming that intelligence tests may be used in all these situa- 
tions, and within limits I believe they may, the question arises 
how this is possible under the concept that general intelligence 15 
a matter of a single basic or even a combination of a number of 
intellectual abilities, It is this question which I shall try to answer | 
this evening. But I must first call your attention to the fact you 
are all aware of, that this is not the usual criticism of intelli- 
Bence tests. The historic and continued objection to intelligence 
tests is not that they measure too much, but that they do not 
measure enough, or at least, not well enough. 

You are all acquainted with the arguments against intelligence 

5 ; Ше damaging criticism per | 
tains, not as is generally emphasized, to the question of reliability; 
but to one of basic validity. Even such studies as those of Well- 
hanges in IQ produced by'? 
factors, though relevant, are 
are those where individuals 
65) but, on overall appraisal, 
ntly, say, one as a defective 
h instances are not necessarily 
exceptions. Here is a situation 
t be by-passed. 
was E. L. Thorndike. His an- 
his approach, was straightfor 


others. But relatively little Һ 
hypothesis. 
In the 1920's Moss published a test of socia 


І С 1 intelligence vn | 
consisted essentially of items involving memory and recognitio? 
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of names and faces, and a series of multiple-choice questions in- 
volving social situations, in which the correct answer seemed to 
have been based on the notion that “the customer is always right.” 
Although Moss's test for a time had some vogue among business 
firms, clinical psychologists, as far as I have been able to dis- 
Cover, seldom if ever make use of it. 

The other important effort at producing a test of social intelli- 
gence is Doll's Vineland Social Maturity Scale. This Scale, as you 
know, Consists of a series of questions listing a variety of social 
Acquisitions, that is, of approved and useful acts and achieve- 
ments, which a child may be expected to have learned from in- 
апсу to adolescence, The Scale is hardly a test in the ordinary 
Sense of the term, since it involves no test performance or re- 
Sponse by the subject, and can be completed, as it usually is, by 
Other persons, But it does correlate fairly well with other tests of 
"elligence and has been shown by Doll and others to correlate 
Positively and significantly with a number of practical criteria of 
Social adjustment. 

(шс Psychologists appear to have accepted performance 

5, almost from the start, as a measure of practical intelligence. 
ШУ they seem to have regarded practical intelligence, as meas- 
kina by these tests, as a kind of special aptitude Ru n a 
jns of intelligence, For many years the situation in clinica’ m 

27 Was Something like this: a child would be given routinely a 
Я еї test, Then, if his Binet МА did not seem to do justice to 
he d he would be given a Pintner-Paterson or similar performance 


I 1 Di 85 а supplementary test. But the child's score on the p 
f ids ance test, except in instances of language Runtime 
| ped i his Binet intelligence 
1 i dn Iter, his 

Tatin tegrated with, or serve to alter, Ro 


- pen. S. Stead, it would usually be used as evidence o 
) ss шогу useful special ability. Thus, if a child attained a НІ г 
| вона ће Binet, апа one of 110 on ће Pintner-Patersor, "hes 
А "nons, PSYchologist would ordinarily give the rating MS 

MR Was Intelligence with good practical or E UE ty. 
С Cop. ПОЕ until the publication of the Bellevue Scales that any 


ereasingly wider use, but I regret to report that their popu- 


{ lad in ia sing е measi 5 R 

| n i l ure of intelligence. The Bellevue tests have 
А arit ; 

ү; егіуе, not from the fact that they make possible 


E verbal 
tests ^" attempt was made to integrate performance and 5 
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a single global rating, but because they enable the examiner to 
obtain separate verbal and performance IQ's with one test. 

The Aristotelian hierarchical white-collar concept of intelli- 
gence dies hard. This, in spite of the fact, that performance tests 
often can and do contain a larger amount of g than do the 
verbal tests. Thus, in his differential study of “Abstract and Con- 
crete Intelligence,” W. P. Alexander, after correcting for com- 
munality, specific factors, and chance errors of measurement, 
found the theoretical g loadings for verbal and practical ability to 
be .60 and .81, respectively. Alexander concludes that “a per- 
fect performance battery would be a better measure of g than а 
perfect verbal battery." 

This and other findings by Alexander bring me to what consti- 
tutes the most compelling evidence for the reorientation in our 
concept of intelligence mentioned at the onset of this paper. I 
refer to the findings contributed by factor analysis. Here two 
Important names appear on the horizon: Carl Spearman and 
L. L. Thurstone. I believe that the answers which they have given 
to the problem of the nature of general intelligence are incorrect: 
But I am sure that without the inspiration and without the tools 
which they furnished us, the solution of the problem would be 
altogether impossible. 

Such a statement before a gathering of clinical psychologists 
may be unorthodox, because to many, factor analysis is almost 
anathema. But I can assure you, on the authority of expert con- 
sultants, that the mathematics of factor analysis is quite elemen- 
tary, and on the basis of my Own experience with it, extremely 
practical; and, with due apologies to Freud, even “sexy.” For 
with what, in effect, does factor analysis concern itself, but with 
the bedfellowship of psychometric tests. For, mind you, it em- 
braces matrices, correlational to be sure, and then tells you 
what test stays close to what other tests when axes are rotated: 
Now that, I submit, is what clinical Psychologists want to know: 
what test, what factor, or, if you will, what function or what trait 
goes with what other factor, or function, or trait, And when the - 
findings are examined some very interesting and unsuspected 
relationships come to light. For example, some tests of intelli- 
gence, like some human beings, are extremely promiscuous. Thus: 
vocabulary, the paragon of verbal tests, correlates very fre- 
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quently, and to a considerable measure, with Block Designs, the _ 
perfect example of a performance test. But to return to a more - 
Serious vein, the importance of factor analysis is, of course, that 
it enables us to discover what our tests measure and the extent to | 
Which they measure the things they purport. A 
_ What are the elements which factor analysis has shown our 
intelligence tests to measure? The first is abstract reasoning. This | 
15 Spearman's g or eduction. Spearman argued that g was the Ё 
Only independent factor, and while he hesitated to identify g 
With general intelligence, his actual applications are tantamount | 
to it. In equating g with general intelligence Spearman was in 
error, not because the tetrad equation is incorrect but because 1n 
Point of fact, it is not satisfied as he claimed. Spearman’s answer | 
to this finding was that we cannot expect the tetrad equation to - 
pe Satisfied by all the tests of general intelligence but only by | 
good” tests of intelligence, like analogies and mathematical rea- 
Soning which require eduction. But of course, if you select your 
tests, you can choose them so highly saturated with a single | 
factor that the residuals vanish. This is all that the tetrad equation | 
Says, and it was the perceptive insight of Thurstone which recog- | 
nized the tetrad equation for what it was, namely, а mathemati- | 
үзі) special case of a more general solution of the factorial prob 
рна needed was а statistica a а vo ae 
ELS rgence of other factors when р er 
's expanded technique, it has now been shown that intelligence. 
abe Such as they are, contain not one but several independent 
om five or six have been definitely MM Bea 
at, induction, verbal, spatial, numerical, ar IV 
Other factors, Notice, however, that these factors, like Spearman's | 
eduction, are all cognitive. 1 
At this point it is important to bear 


Stands for in factor analysis. Basically, і і 
Pendent variable which accounts for à certain portion of the | 
total test variance in a correlational matrix. The amount of yari- 
‘tte it accounts for in any given test is called the I. 
ERE In a perfectly factorialized correlation matrix, the sum | 

the factorial loadings of the extracted factors should be 100 + 
Per cent, that is, account for the total test variance. 


Ow, it is a remarkable finding that when matrices of intelli- | 


in mind what a factor 
t is an identifiable inde- | 


ШР > 
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gence tests аге factored, the amount of variance accounted for is 
seldom more than 60 per cent of the total, and, what is perhaps 
of equal significance, the greater the number of different tests in- 
_ cluded, the smaller, generally, the total per cent of variance ac- 
. counted for; and this is seemingly independent of the number 
r of factors extracted. In the case of our present intelligence test 
. batteries, factors beyond the first 3 ог 4 usually contribute so 
| little to the already accounted-for variance that it is generally 


. not profitable to extract them. It is the observation of this im- 


3 portant finding that in the factorialization of batteries of intelli- 


. gence tests, there always remained a considerable per cent of 


- — оз "жа, 4 


_ unaccounted-for variance, which be 


praise traits of character, was able 
jn a broad sense seemed to relate 
pensity, which he called conscien 
sistency. A few years later, in Spearman's own laboratory, Lankes 
and Wynn Jones (7) demonstrated the existence of another 
non-intellective factor, “р,” or perseveration, which characterized 
their subjects, tendency to resist changes in set, and which Spear- 


to extract a factor “уу,” “W” 
to а moral and conative pro- 
tiousness or Purposeful con- 
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man related to his law of inertia. In 1921, W. M. Brown (2) 
discussed character traits as factors in intelligence tests, and 
1933, R. B. Cattell (3) reported correlations between tests of 
temperament and ratings in intelligence. But perhaps the most 
crucial findings are those of W. P. Alexander (7) who, in an 
extensive factor analysis of a large series of verbal and perform- | 
ance tests, supplemented by tests of achievement and academic 
marks, showed that in addition to the now familiar g, V (verb 
ability), and P (practical ability), а considerable portion of va 
ance had to be ascribed to two other extracted factors, nami 
X and 2, X was a factor which determined the individual's i 
terests and “concerns,” in Alexander’s words, “temperament 
Tather than ability”; while Z was “an aspect of temperament re- 
lated to achievement,” in the case of Alexander's subjects, 
School achievement. ) 
Тһе Ғасіог loadings of X and Z varied greatly from test to 
test, but even some of Spearman's ostensibly pure tests of 8 
Contained some Z and nearly all the performance tests showed 
considerable Х or Z loadings. As might be expected, these fac- 
tors played an even greater role in academic or technical achiev: 
Tent. For success in science, for example, the X factor loading. 
Was .74, as against only .36 for g, and for English .48 as against 
:43 for the g loading. From these findings one might even infe Г 
that lack of intellectual ability, beyond а certain point, accounts, 
for relatively little of school failures. Indeed Dorothea McCarth; 
(6) recently offered the "hypothesis," and I quote, "that emo 
tional insecurity . . . is the basic cause of most educational 
disabilities and learning failures, which are not due to mental | 
defect,” ( 
What are we to make of these two findings? First, that factors 
Other than intellectual contribute to achievement in areas where, 
as in the case of learning, intellectual factors have until recently 
been considered uniquely determinate, and, second, that these 
tions and abilities hith 
Considered traits of personality. Among those parti 
50 far are factors relating primari 
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sons that not much more has been done is that psychologists 
have continued to assume that personality has little to do with 
intelligence. To Thurstone as well as to Spearman, general in- 
 telligence seems to be first and foremost а cognitive function, 
by Spearman to be accounted for by a single pervasive factor, 
by Thurstone by a number of factors. 
It is curious that the clinical psychologist, so little impressed 
1 by, or, at least, so little conversant with factor analysis, has 
almost from the start dealt with intelligence test findings as if 
the personality components in intelligence were already an es- 
tablished fact. For what does psychological diagnosis on the 
basis of intelligence test findings consist of but inferring adjus- 
_ tive capacities of the subject as а persona? It appears that the 
. clinician, like the character in Moliere's Malade Imaginaire, 
has been speaking prose all his life without knowing it. 
І One might add that diagnosing personality and personality 
disorder, at the level on which it is being done, is not very diffi- 
cult. Practically every good individual test of intelligence lends it- 
| or lesser degree, the Bellevue 
of Intelligence perhaps a little 
hat they are tests of personal- 
intelligence tests contain ele- 


poorly on the Digit Span Test, it is not because of defective 
. memory, but generally because of a basic anxiety mobilized by 
. the test, as by any other situation, in which he is seemingly on 
_ trial. Conversely, when a mental defective does relatively well on 
the Maze Test, it is generally not because he has better plan- 
- ning ability, but because he is less impulsive. Similarly, a large 
А variety of traits and personality factors тау be inferred from 
_ test performance—for example, energy level from a subject's 
A performance on the Digit Symbol, asocial tendencies from general 
. comprehension, masculinity-femininity from the picture com- 
pletion test. These are only a few of the traits and diagnostic 
constellations with which every clinician who has done psycho- 
logical diagnosis is familiar. | 

Тһе point here is not that personality traits сап be discovered 
in psychometric performance, or, what needs no Special argu- 
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ment, that personality and abnormal conditions influence intel- 
ligence test findings, but that personality traits enter into the 
effectiveness of intelligent behavior, and, hence, into any global 
concept of intelligence itself. It is one thing if a child does poorly 
On an intelligence test because he is disinterested or upset and 
quite another if he is congenitally impulsive or emotionally un- 
stable. 

One would naturally suppose that if intelligence is a function. 
of the personality as a whole, one should find significant positive | 
Or negative correlations with measures of personality itself. Such, 
indeed, are the findings, but the results are extremely hard to 
evaluate. This is in part due to the fact that the studies in this 
area have been done primarily with the intent of discovering the 
extent to which intelligence accounts for variance in personality. - 
In an article which appeared in 1940, Irving Lorge reviews the 
Studies published to that date on the general relationship between: 
measures of intelligence and various measures ог estimates of 
Personality. The personality tests included most of the current 
ànd older inventories (Woodworth, Laird, Thurstone, Bernreuter, 
Allport, et al.), as well as the association experiment and the 
Personality measures of Hartshorn, May, and Maller. Some 200 
Correlation coefficients were analyzed. The range of coefficients 
Was from +.70 to —.49 with a median of 4-04. Disregarding 
the signs, half of the ratios were between .00 and .15, and one 
quarter of them .30 and above. Lorge’s general feeling about the 
findings is that the range is 50 “extraordinary that anybody can 
Таке any statement.” Nevertheless, his conclusion is “that some 
Correlation between intelligence and personality exists” (5). 

All this is rather meager fare, but the findings are perhaps as 
Satisfactory as could be expected. Apart from the known unre- 
liabitity of paper-and-pencil inventories, there is the more dis- 
turbing fact of their uncertain validity and relevance. At times 
they do not measure the traits claimed for them, at others they 
Measure only small segments of the personality, although in 

ferent ways; and at still other times, traits which are purely 

Nominal. The latter, for example, was shown by Flanagan (4) 
to be the case with the Bernreuter Inventory dichotomies. In the 
Өгіріпгі publication the test was scored for six different traits, 
Which by factorialization were then reduced to two. 
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Flanagan's study is a good example of how factor analysis 
aids us in getting at basic components. Mere evidence of con- 
comitant variation is not enough; in fact, it is often misleading. 
For example, defective hearing may have a measurable effect 
on both learning arithmetic and size of vocabulary, but, obvi- 
ously, has no basic relation to either arithmetical reasoning or 
verbal ability. A variable to be basic and scientifically significant 
must be independent. In the case of man’s cognitive functions, 
these independent variables, in so far as they are relevant to 
general intelligence, have been pretty well identified. It may be 
possible to add one or two to Thurstone’s list, but not many 
more. Those of personality are yet to be discovered, We have 
some knowledge of what the factors to be measured are likely 
to be, some on the basis of researches like those of Webb, Alex- 
‘ander, Guilford, Cattell, and Eysenck, others on the basis of 
general observation and clinical experience. The latter have thus 
far gone unrecognized, not only because we have no tests for 
them but because clinicians, like their more academic colleagues, 
still think of intelligence as consisting primarily of cognitive 
abilities. Any bit of behavior that seems concerned with or re- 
lated to instinct, impulse, or temperament is ipso facto consid- 
ered as having no direct relation to general intelligence. 

Such, for example, is curiosity: This was one of the traits 


which Terman in his studies of genius found most frequently ~ 


d 

4 among his gifted children. But he did not have, nor do we as 
| yet have, any test of curiosity. No attempt has been made to 
extract curiosity as a factor of intelligence. We all know how 
- important curiosity is for biologic adaptation as well as scientific 
achievement. It is, to quote McDougall, “at the basis of many 
of man’s most splendid achievements, for rooted in it are his 
speculative and scientific tendencies," and “. . . in men in whom 
curiosity is innately strong, it may become the main source of 
intellectual energy and effort.” But what is curiosity? “It is the 
impulse to approach and examine more closely the object which 
attracts it,” that is an instinct, and according to McDougall, one 

of the basic instincts. 
One need not be afraid or ashamed to acknowledge impulse, 
instinct and temperament as basic factors in general intelligence 
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It is indeed because I believe they are that I have brought be- 
fore you the arguments and evidence presented. My main point 
has been that general intelligence cannot be equated with intel- 
lectual ability, but must be regarded as a manifestation of the 
Personality as a whole. I have tried to show that factors other 
than intellectual enter into our concept of general intelligence, 
pna that in everyday practice, we make use of them knowingly 

r not. 
What is needed is that these factors be rigorously appraised. 
Factor analysis has been emphasized because, at present, it is the | 
Only method which enables us to demonstrate and discover in- 
dependent variables. We already have some clues as to what the 
Non-intellective but relevant factors of intelligence may be. What | 
We now need are tests which not only identify but measure them. | 
This in effect demands broadening our concept of general intel- - 
ligence and calls for a revised psychometric to measure these 
added variables as sub-tests of all general intelligence scales. | 
То say that general intelligence can be social and practical, | 
as Well as abstract, was just a beginning. We had to know what | 
Sasic components of the mind were responsible for making an | 
Individual effective in one rather than in another area. 

To realize that general intelligence is the function of the per- 
Sonality as a whole and is determined by emotion and conative | 
factors is also just a beginning. We now need to know what non- 
intellective factors are relevant and to what degree. This is the | 
task which lies immediately before us. à 
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A Nonintellectual Intelligence Test 


Harrison GoucH 


Wechsler presented evidence that personality qualities are 
vealed by the kinds of answers people give 10 the sorts of ques- 


tions intelligence testers ask them. Harrison Gough, approaching 


the matter from the opposite direction, has accumulated consid- 
be assessed by the kind: 


erable evidence that intelligence can 2 

questions personality testers typically ask. The paper is entitled 
A Nonintellectual Intelligence Test” and is reprinted from 
Journal of Consulting Psychology, 1953, 17, 242-246. It is re 
Printed with the permission of the author and the American 


P SYchological Association. 


, The title of this paper may be something of a misnomer, | 
tis not at all certain that the testing instrument which is go 
10 be presented is, actually, a measure of intellect. Neverthel ess, 
it does Correlate significantly with conventional tests of int i 
gence, and seems to reveal other properties which suggest that 
*omething along the line of intellectual ability, or perhaps aa 
Precisely intellectual efficiency, is being appraised. Тізе” о 
Part of the title—the “nonintellectual” part—has not Бер 
Ее of апу misgivings, because, aS will be seen shortly, the 
Instrument does not call for any problem solving, reasonit 
арас! thinking, or апу of the other mental functions whi 
аге traditionally regarded as the key factors In E 
"asuring intelligence. 
Mine whether a criterion-specific set of person 4 
Ms Could be assembled idi would correlate шты. 
to ete Measures of intellect, and second, if this was succ eal 
‘© determine whether the individual items could be comm 


un 
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E. 
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.a scale which would have anything approaching practical sig- 
nificance and value. 

_ The second objective is added, because, as we know for in- 
stance from work on the Rorschach (7), a series of variables 
.can easily be identified which will correlate significantly with 
intellect, but which will seldom rise above the level of +.20 and 


. 725 into a region of more dependable utility when pooled in 
“а composite, 


"PROCEDURES 


Тһе first step in the present project was to write a series of 


‘criterion-specific inventory items, and also to select appropriate 
‘items from standard sources. An example of a specially written 
item would be, “I get sort of annoyed with writers who go out 
of their way to use strange and unusual words," and of an item 
trom a standard questionnaire, in this case the MMPI (5), "I 
gossip a little at times.” | 


| _ These items were then reproduced in a booklet and admin- 


istered to the senior students in four Minnesota high schools. 
Іп each school, the responses of students in the upper 25 per 
cent of the range on a conventional intelligence test were com- 
pared with those of students in the lower quartile.? 

-. Table 1 provides an example of the way in which the analysis 
зз conducted. Items which showed consistent and significant 
| di Пегепсев in all Hi-Lo comparisons were retained for the scale. 
Altogether, 76 items were identified which met this criterion. 

= These 76 items were scored on the original samples with the 
© results indicated in Table 2. The next Step was to cross-validate 
_ this scale. Table 3 presents the results observed in six Cross- 


М i'The four communities were: Bemidji, Dawson, Redwood Falls, 
Гапа St. Cloud. The writer wishes to thank the following persons for 
making this testing possible: Mr. R. B. Clay, Mr. С.Н. Dahlin, Mr. 
Н. B. Gough, Mr. R. Gray, Mr. J. W. Smith, Mr. В. Н. Sorenson, 
Mr. С. Ramseth, and Mr. К.Н. Witt. 

| 2 Because of the small number of cases available, schools А and В 


were combined into a single sample for this analysis. 
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v. TABLE 2 


Summary Statistics for the First (76-item) Intellectual 
Efficiency (Ie) Scale in the Original Samples 


i Sample N M SD r* 


School A 135 52.44 8.51 .47 
School B 35 51.34 9.20 .68 
School C 66 51.41 9.41 :64 а 
School D 205 51.93 9.51 54 


. *Intercorrelations between the e 
each of the schools. 


scale and a conventional IQ test in 
validating samples. In the first five, only MMPI (5) items were 
available, but the sixth sample took the full 76-item scale. АП 


uate student sample where 
ttenuation of the criterion 


“Тһе first four samples were made available through the kindness 
f Mr. M. J. Lunemann, Dr. Starke Hathaway, Mr. F. J. Herda, and 
amples were seen at the 
ality Assessment and Re- 


4 Қамын wing criterion variables: 
iagnostic competence (.21); individual psychotherapy (32); profes- 


sional interpersonal relations (.28); over-all clinical competence (.23); 
preference for hiring (.24); and liking (.23). 
ү The correlations for professional interpersonal relations and for 
individual psychotherapy were both the second highest obtained among 
all the objective scales utilized in the Michigan study (including the 
‘Miller Analogies Test, 6 Primary Mental Abilities test scales, 14 
Guilford-Martin scales, 10 conventional MMPI scales, 59 scales on 
the Strong Vocational Interest Blank, 9 Kuder Preference Inventory 


scales, and 6 scales from the Allport-Vernon Study of Values). 
Я 


aui nt A de Шалы 
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The individual items were also checked in the two graduate | 
Student samples, and it was discovered that 24 of them were | 
Contributing only slightly, if at all, to the correlations with the 


TABLE 3 


Summary Statistics for the First Ye Scale 
in Six Cross-validating Samples* 


Sample N M SD 

1. For the abbreviated (59-item) scale 
: St. Cloud ninth grade 82 38.09 7.46 
- Minneapolis ninth grade 190 39.44 8.24 


- St. Cloud twelfth grade, 1947 231 39.55 7.50 Д 

* St. Cloud twelfth grade, 1948 271 40.30 770 . 

+ University of California ] 
advanced graduate 42 
Students 40 48.58 402 2. 


For the full (76-item) scale 
University of California 


first-year graduate n 
Students in psychology 30 63.20 512 44. 


оь ом ~ 


Ir. 


ж р ; 
ш uM йн ue samples were scored only for the nd items taken from | 
| + The psychology sample took the full scale. 2M 
uror the two graduate ЕЧЕН! sapit the criterion test was the Miller 


ere ze Test, form в. For the other samples, conventional IQ measures. 


1 Ж 
; Criterion t А liminate them | 
and ta €sts. It was decided, accordingly, go DE ale iS dg 
ne ы -educe the scale to 52 items. This 52-item scale IS 106 
hich is currently being used, and it is also the version 1n- 
ECCE E 
5 
‘ing “table нен i in each sample respond. - 
pep te ee а эш ВЕ 
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cluded in the California Psychological Inventory.°.7 These 52 
_ items, and the scored responses, are listed below. 


21.1 have had very peculiar and strange experiences. (False) 2. It 
. often seems that my life has no meaning. (False) 3. When someone 
| does me a wrong, I feel I should pay him back if І can, just for the 
principle of the thing. (False) 4. Any job is all right with me, SO 
. long as it pays well. (False) 5. People often expect too much of me. 
. (False) 6. I get sort of annoyed with writers who go out of 
5 their way to use strange and unusual words. (False) 7. Success is а 
. matter of will power. (False) 
y 


8. When in a group of people I have trouble thinking of the right 
Е to talk about. (False) 9. It is more important that a father 
К be kind than that he be successful. (True) 10. I was a slow learner 
_ in school. (False) 11. I must admit I have no great desire to learn 

new things. (False) 12, My skin seems to be unusually sensitive to 
touch. (False) 13. Parents are much too easy on their children now- 
_adays. (False) 14. I read at least ten books a year. (True) 
15. I have the wanderlust and am never happy unless I am roaming 
or traveling about. (False) 16. My parents have often disapproved 
of my friends. (False) 17. Teachers often expect too much work 
from the students. (False) (18). I am not afraid of picking up a dis- 
ease or germs from door knobs. (True) 19. I am quite a fast reader. 
(True) 20. I have had more than my share of things to worry about. 
(False) 21. I feel like giving up quickly when things go wrong. 
False) 


- 22.Ina group of people I would not be embarrassed to be called 
Тороп to start a discussion or Bive an opinion about something I know 


“Тһе California Psychological Inventory, copyright 1951. This in- 

_ ventory is designed to assess a number Of social and interactional 

variables. Its emphasis is not on medical, psychopathological, or mal- 

adaptive characteristics, but, rather, on more favorable and positive 

Ms oM functioning. It contains 19 scales, including 

measures for social responsibility, flexibility, academic motivation, 
tolerance, etc. See, for example, references (3) and (4). 

* Thirty-nine of the 52 items were taken from the MMPI (by per- 
mission of the copyright owners), and the remaining 13 items were 
original. The 39 MMPI items, and their scorings, are as follows 
(numbers given are for the MMPI group form booklet): 13F, 28F, 
33F. 35F, 36T, 37T, 60T, G2F, 63T, 78T, 116F, 122T, 146Е, 149F; 
194p, 198F, 221Т, 224F, 225T, 256F, 260Е, 267Е, 2771, 280F, 
304F. 338F, 392F, 448F, 455Е, 462Т, AGAT, 487Б. 492F, 521T. 
524T, 526F, 541F, 546T, 552T, 559F. 
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4 
қ Well. (True) 23. I like to read about history. (True) 24. In school I 
a found it very hard to talk before the class. (False) 25. I dread the 

thought of an earthquake. (False) 26. I like science. (True) 27. I am 
bothered by people outside, on street cars, in stores, etc. watching me. 
(False) 28. I have never been in trouble because of my sex behavior. 
(True) 

29. I often get feelings like crawling, burning, tingling, or "going | 
to sleep” in different parts of my body. (False) 30. I seem to be. 
about as capable and smart as most others around me. (True) 31. TE 
б like poetry, (True) 32. I am quite often not in on the gossip and talk - 
1 Of the Broup I belong to. (False) 33. A windstorm terrifies me. - 
(False) 34, Т enjoy a race or game better when I bet on it. (False) 


- Most people make friends because friends are likely to be useful | 
lo them, (False) 4 

| 36. 1 have never seen а vision. (True) 37. The future seems 
i hopeless to me. (False) 38. I have had no difficulty starting or hold s 
Үз ing my urine. (True) 39. I often feel as if the world was just passing | 
^ me by, (False) 40. I get pretty discouraged with the law when a 
Smart lawyer gets a criminal free. (True) 41. The only interesting | 

part of the newspaper is the “funnies.” (False) 42. I gossip a little at 

ў E ше) the cl ess of 
; At times T h entertained by the clevern б 
{ТООК that I һауе re get by with it. (True) 44. I have. 
d Attacks in which I could not control my movements or speech, - 
t in which I knew what was going on around me. (False) a 
| (Tre had no difficulty in starting or holding my bowel mov ай 
ШР в е) 46. I like to read about science. (True). 47. is P i M 
ss editorial in the newspaper every day. (True) 48. peer sala 
í (False). hs шш for me, I would have m much more s s 
- - I daydream very little. (False 1 N 
nos s I have often been месі in the middle of the night. (False) 


7. Work under a great deal of tension. (False) 52. Т зейош уры І 


Sut my health, (True) 


? i : o in hiehliehting so 
ms Teview of these items is quite interesting in highlighting 


© Personologi f general intelligence. The best 
Method ological correlates of g ‘cations of the items 


s 9f extracting the immediate implicatic REO 
Іш M Y to read the list carefully, but as an aid in Nui 472 МИ 
mgs and clusters the following synopsis is provides: 


Т, bstani 
ateq Self-confidence and self-assurance, freedom from 005005 6 
Sand apprehensions. 
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2. Effective social technique and adjustment, sense of social accept- 
ability without dependence on others; not suspicious, touchy, or overly 
sensitive. 4 А NW 

3. Good physiological functioning, absence of minor, debilitating 
symptoms and complaints. | 

4. Liking, and respect, for intellectual pursuits; wide range of in- 
terests. 


Three additional samples were then obtained in order to cross- 
- validate the 52-item revised scale.5 Table 4 presents the findings. 


TABLE 4 


Summary Statistics for the Revised (52-item) Ie Scale 
in Three Cross-validating Samples 


Sample N M SD* r^ 


. 1. Rock Island, Illinois high school 461 33.90 7.07 .49 
2. Wellsville, New York, high school 230 34,08 6.39 .50 
3. University of California under- ^ 


Қ 
1 graduate psychology students 43 40.05 516 .42 


* Intercorrelation between the Je scale and a conventional measure of 
ў intelligence іп each sample. 


.. The validity coefficients are about what they were with the first 
| | Six cross-validating samples, so it appears that the shortening did 
not weaken the scale's effectiveness. 

Final high school grade averages were also available for the 
Rock Island sample. For the females, the correlation between 
grades and tested IQ was .56, and between grades and the Je 
scale .59. For males the correlation between grades and IQ was 
.5] and between grades and the Je scale .31. 

In order to provide an over-all picture of the summary sta- 
tistics at this point, the means and standard deviations for each 


с Island, Illinois, sample was obtained through the cour- 

ewm О. Austin, Jr.; the Wellsville sample through the 

tesy О f Dr. H. D. Babcock; and the University sample through 
es of Dr. David Krech and Mrs. Ann Miller. 
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sample have been proportionately equated to the 52-item test 
version with the results indicated in Table 5. In this table one 
сап observe a consistent rise in mean scores from junior high 
School groups, through senior high school and college under- 
graduate levels, to a final culmination in the graduate student 
samples. 


ADJECTIVE CHECK LIST 


The last data to be presented on this scale have to do with 
the "social-stimulus values" of persons scoring high and low on 
. it. Forty graduate students seen in an intensive 3-day assessment 
at the University of California Institute of Personality Assess- 
ment and Research were given the scale. Staff judges completed 
. Gough Adjective Check Lists (2) for each assessee, and then 
_ these observer-reports were composited. Adjectives differentiating 
significantly between the composite reports on the 10 highest and 
10 lowest scorers on the Je scale are given below: 


1. Adjectives checked more frequently about higher scorers. 


| adaptable kind 

í appreciative logical 

1 capable obliging 

| i clear-thinking persistent 

^P conscientious planful 

1 considerate pleasant 

A : cooperative reasonable 

Ji dependable realistic 

d energetic reliable 
enterprising responsible 
helpful sincere 
honest stable 
industrious thorough 


interests wide 


2. Adjectives checked more frequently about lower scorers. 


aloof impatient 
cynical individualistic 
defensive moody 
deliberate Tesentful 
effeminate sarcastic 


headstrong 


sharp-witted 


ү 
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The general trend of adjectives ascribed is quite clear. High 
Scorers are described as capable, clear-thinking, dependable, logi- 
cal, realistic, etc., and low scorers as cynical, headstrong, impa- 
tient, and resentful. 

The adjective findings lend support to the notion that the 1е 
Scale is measuring something like personal or intellectual effi- 
ciency, with their emphasis on characteristics such as industrious- 
ness, planfulness, reliability, and thoroughness. 


SUMMARY 


A study was made of the relationship between intellectual 
Measures and a series of opinion, attitude, and self-description 
items believed, on a priori and theoretical ground, to covary 
With intellect. Fifty-two items were found to possess empirical 
Validity. These items were assembled in a scale which yielded 
median validity coefficents of approximately .58 in four original 
Samples, and of .47 in nine check samples. Р 

Adjectival descriptions of subjects scoring high on the scale | 
tended to stress factors of dependability, intellectual clarity, per- - 
Sistence, and planfulness. The decision was made to call the scale 
а Measure of "intellectual efficiency” in order to reflect these 
Properties. 
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| INTELLIGENCE 
| OR INTELLIGENCES? 


8 
Тһе Abilities of Man 


CHARLES SPEARMAN 


The question of whether "intelligence" is essentially a singular 
or a plural word has challenged psychologists since the scientific 
Study of intellect began. The raw material for all the mathemati- 
cal investigations of this problem is a table of correlations be- 
tween scores a group of subjects make on several tests. These 


patios always turn out to be positive; they never turn out 
The | perfect. What can we make of this combination of facts? 
eae od by which meaning 1s extracted from large sets of 

correlations is called factor analysis. It has already been 
үа to in some of the previous papers in this book. (Wechs- 
ers description of the method for clinicians constitutes а light- 


h В : 
earted introduction for nonmathematical readers.) 
tion of mental abilities 


The first serious studies of the organizai 
еге undertaken by Charles Spearman. The presentation re- 
Printed here is from pages 73-82 of his book, The Abilities of 
Мн (New York: Macmillan, 1927). Footnotes and references to 
te Appendix have been deleted. 


» The start of the whole in- 


Criterion of “tetrad differences. 
de in the correlations calcu- 


iud qe a curious observation made orre 
[2 etween the measurements of different abilities (scores for 
tests, marks for school subjects, ОГ estimates made on general 
Mpression), These correlations were noticed to tend towards a 
Бо шаг arrangement, which could be expressed in a definite 
la ematical formula. And the formula thus originally reached 
eVer since been maintained without any essential change. 

it has been converted 


© 1 + 
ral from time to time, for convenience, 
m one form to some other that is mathematically equivalent. 
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The form recently preferred is given below. In it, as usual, the 
letter r stands for any correlation, whilst its two Subscripts indi- 
cate the two abilities (tests, school marks, etc.) that are corre- 
lated. 


Tap X љу — Taq X тр = 0. 


This formula has been termed the tetrad equation and the value 
Constituting the left side of it the tetrad difference. 

An illustration may be afforded by the following imaginary 
correlations between mental tests (actually observed correlations 
will be given in abundance later on): 


Oppo- Com- Discrim- Cancel- 

sites pletion Memory inatlon lation 
Opposites 1 .80 -60 30 30 
Completion 2 .80 48 24 +24 
Memory 3 60 48 18 -18 
Discrimination 4 .30 .24 18 .09 
Cancellation 5 -30 24 18 .09 


For instance, let us try the effect of making: 
denote Opposites, 

" Discrimination. 
Completion, 
Cancellation. 


a 
b 
р 
4 


From the tables of correlations above, we See that r,, will mean 


-80 X .09 — 30 x 24-0 


which із obviously correct. And so Will be found any other ap- 
plication whatever of the tetrad equation to this table, 

The Two Factors. So far, the business is confined to matters 
of observation; we simply try out the tetrad equation on any 
table of actually observed correlations and examine whether it 
fits. The next step, however, is not observational, but purely 
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mathematical; we have to ask how, if at all, this equation be- 
tween the correlations bears upon the individual measurements 
of the correlated abilities. The answer is that there has been 
Shown to exist a very remarkable bearing indeed. It is to the 
effect that, whenever the tetrad equation holds throughout any 
table of correlations, and only when it does so, then every in- 
dividual measurement of every ability (or of any other variable 
that enters into the table) can be divided into two independent 
Parts which possess the following momentous properties. The 
One part has been called the "general factor" and denoted by the 
letter 8; it is so named because, although varying freely from 
individual to individual, it remains the same for any one indi- 
Vidual in respect of all the correlated abilities. The second part 
has been called the "specific factor" and denoted by the letter s. 
It not only varies from individual to individual, but even for any 
One individual from each ability to another. The proof of 
this all-important mathematical theorem has gradually evolved 
through successive stages of completeness, and may now be re- 
garded as complete. ) E 
Although, however, both of these factors occur in every ability, 
they need not be equally influential in all. On the contrary, the 
Very earliest application of this mathematical theorem to psy- 
chological correlations showed that there the g has a much 
Breater relative influence or "weight" in some of the abilities 
lested than in others. Means were even found of measuring this. 
Telative weight. At one extreme lay the talent for classics, where 
the ratio of the influence of g to that of s was rated to be as | 
Much as 15 to 1, At the other extreme was the talent for music, 
Where the ratio was only 1 to 4. 
Here at once we have before us the essence of the whole doc- 
trine, the seedling from which all else has sprung. But notice 
Must be taken that this general factor 8, like all measurements 
anywhere, is primarily not any concrete thing but only a value 
9r magnitude, Further, that which this magnitude measures has 
not been defined by declaring what it is like, but only by pointing 
Out where it can be found. | 
.. It consists in just that constituent—whatever it may be—which 
15 common to all the abilities inter-connected by the tetrad equa- 
tion. This way of indicating what g means is just as definite as 
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when one indicates a card by staking on the back of it without 
looking at its face. 

Such a defining of g by site rather than by nature is just what 
was meant originally when its determination was said to be only 
"objective." Eventually, we may or may not find reason to con- 
clude that g measures something that can appropriately be called 
"intelligence." Such a conclusion, however, would still never be 
the definition of g, but only a “statement about” it. . . 5 

Suggested universality of g. Тһе vital problem, in respect of 
empirical observation, is as to how far and how regularly our 
tetrad equation actually holds good. In the original work, ап 
extremely wide generalization was adventured, The suggestion 
was made that 


all branches of intellectual activity have in common one fundamental 
function (or group of functions), whereas the remaining or specific 


elements seem in every case to be wholly different from that in all 
the others. 


Here, then, lies the justification for attributing so much impor- 
tance to g, despite its purely formal character, The view is put 
forward that this g, far from being confined to some small set 
of abilities whose inter-correlations have actually been measured 
and drawn up in some particular table, may enter into all abili- 
ties whatsoever. 


Such a universal law could only be advanced very tentatively. 
Тһе express caution was added that 


it must acquire a much vaster corroborative basis before we can ac- 


cept it even as a general principle and apart from its inevitable cor- 
rections and limitations, 


This caution was the more imperative, seeing that the law not 
only had such a tremendous Scope, but moreover came into 
sharp conflict with the most authoritative Psychology then pre- 
vailing, the latter being at that time wedded to the doctrine of 
independence. 

Utility of the doctrine in practical testing. Тһе preceding doc- 
trine—as we shall see later—admits of usage throughout almost 
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every kind and description of problem within the whole domain 
of individual difference of ability. For the present, however, we 
will only allude to two of the most obvious of these applications. 
OU one consists in the power conferred of measuring any 
ividual in a genuine manner. . - We can determine the 
ше of his g which will tell us nearly everything about 
p his abilities and something about nearly all of them. ... 
E eh ea we can do the same as regards any of his 95, one for 
istinct kind of performance: this supplements and com- 

pletes the information supplied by his 8. - - * 
К other immediate application of the doctrine is in the con- 
a ction of mental tests. We are enabled to ascertain just the 
ELT of accuracy with which any given test, ог series of them, 
i measure either a person's 6 ОГ any of his в. Further, we 
arn how this degree of accuracy may be raised to its maximum. 


We can already see, too, that some crude approach towards 
ingly unscientific course 


S ERN o a common hotchpot. 
oing does not indeed supply an average, or even а герге- 
SE s abilities; anything of the sort 

ms to be for ever precluded by the impossibility of fulfilling 
quc does effect is to make 

е influences of the many specific factors more or less neutralise 
each other, so that the eventual result will tend to become an 


a : 
Pproximate measure of g alone. 


DISCREPANCIES BETWEEN THEORY 
OBSERVATION 


т ien of sampling errors. Although we have above suggested 
d е range of g as indicated by the tetrad equation 15 really 
i ersal, this must not be taken to mean that the said equation 
d all conditions well satisfied. To expect this would be as 
the B as to infer from the law of conse 
е aman, сап чаш 15 always Bro 
Dod of food he eats. The manifestations of a | 
u er mental ог physical, are bound to be more or less inter- 

ngled with, and modified Бу, further influences. For such in- 


22. niti 
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fluences, then, all due allowance must be made. In order to verify 
the law of Two Factors, actual experiment should not satisfy 
the equation exactly, but instead should present exactly the right 
departure from it. If a marksman wishes to hit the bullseye he 
does not aim plump at it but more or less to one side, according 
to the direction and strength of the wind. 

Now, all such inevitable complications of the theorem will be 
treated in detail later on (ch. X.). But about two of them—to 
obviate gross misapprehensions—a few words may be said forth- 
with. One such complication derives from the “errors of sam- 
pling.” In any actual investigation only a limited number of 
individuals—ranging generally from 50 to 1,000—can. actually 
be measured; these have to be accepted as a representative sam- 
ple of the entire class of persons under consideration. But be- 
tween the correlation found for any such mere sample and that 
truly holding for the entire class, there must naturally be ex- 
pected some random discrepancy. The general size of this for 
any single correlation has long been ascertained; about half of 
the discrepancies will be greater and about half less than a cal- 
culable value called the “probable error” of the correlation. Every 
table or correlation must, then, be looked upon as consisting of 
the true values Peppered over with, and more or less disguised 
by, random positive or negative additions: the general size of 
these, however, will bear a predictable relation to that of the said 
“probable error.” 

Such disturbances of the correlations cannot but exercise some 
effect upon our “tetrad differences,” since the latter are con- 
structed out of the former. Consequently, if the true value of 
the tetrad differences is always zero as shown in the tetrad equa- 
tion (p. 73), then the actually manifested values ought not to be 
always zero, but instead should present some deviations from 
this. We need to ascertain how large these deviations should tend 
to be. 

To discover this—or more broadly speaking, to make allow- 
ances for the disturbance of the correlations by their errors of 
sampling—has been the greatest trouble in the whole develop- 
ment of the doctrine. In the earlier investigations, the degree 
of allowance was left for anybody to estimate as high or as low 
as he pleased. Such a procedure, of course, is unscientific and 
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misleading. Later on, the artifice was devised of replacing the 


tetrad equation by another criterion, which would at any rate 


be approximately correct and which did admit of calculating the 
ampling. This substitute 


allowance to be made for the errors of s 
criterion was called that of "inter-columnar correlation." Quite 
recently, however, this long-standing grave defect in the doctrine 
has at last been overcome. Means have been discovered for 
evaluating the effect of the disturbance in the case of the true 
Criterion, the tetrad equation itself. Knowing (as we always do) 
the probable errors of the four correlations that enter into the 
tetrad difference (see p. 90) we can now 
probable error of the tetrad difference as а Whole. » - - 
Overlap between specific factors. As mentioned, there is an- 
Other conspicuous limitation to the doctrine we are considering. 
Obviously, the specific factors for any two performances can only 
Бе independent of each other when these performances are quite 
different, When, on the contrary, two performances are much 
Re their respective specific factors will necessarily cease to 
€ mutually independent. 
, For example, take as one test the cancellation of all the a's 
Іп a printed page, and as another test the cancellation of all the 
68. These two performances, being SO extremely alike, may 
Naturally be expected not only to have the g factor in common 
but also to present a large overlap in respect of the s factor. The 
Case may be symbolized in the following figure, where the verti- 


deduce from these the. 


ni shading (top left and the bottom circles) | : 
е g in cancelling a's, whilst the horizontal shading (top right 


a + Н б 
a the bottom circles) stand for the s and g in cancelling e's. 
епеуег such cases аге introduced, then our tetrad equation 


must į 5 
St in general cease to be valid. 


stand for the 5 and ^ 
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But where, it may be asked, shall the line be drawn Eden 
erformances which are and those. which are not "qu 
paces 5 ” Тһе answer must be that this is not a point to settle 

OUS but to ascertain by experiment. Performances should 

intuitive x as quite different—in the present signification of 

e. ERN E TE as the tetrad equation is satisfied and no 

БІР eae some notion, however, of how this rule pans out 

longer. Ж Б: it may at once be said that the most striking 

in actua nu RA overlap was afforded by just these two tests 
pay consist of cancelling letters and only differ as to which 
fet РДЫ ald be cancelled. Another instance of likeness found 
peter шш marked overlap was that between counting dots one 
to produce 4 doing so three at a time. А somewhat different 
eden d found in school subjects; the correlation between 
postice LEA Grammar and those for Latin Translation proved 
marks pu. to fit into our tetrad equation. ; 
far too la ly, such overlaps are akin to the “common elements” 
Evident Уе taken by Thorndike, Judd, Sleight, and others 
which uw any "formal training" that may exist (see ch. iii. 
to account our overlaps might also derive, it was found, from 
. 36). Bu e or less accidental circumstances. Thus, some of the 
arious сат been learning Latin for a longer period than the 
children Ба therefore naturally enough tended to excel at both 
inciso + andthe Drap sia By this fact, of course, the 
the ааа ween the two abilities must have been increased 
EU. amount due to g alone. 

Ta y; general, the early investigations indicated that the cases of 
appreciable overlap are surprisingly scarce: that is to say, it ap- 
peared only to link together abilities that were allied very ob- 
viously. But already at this early period an exception was an- 
nounced. It consisted in the overlap found between the memo- 
rizing of syllables and that of numbers. This observation was said 


to indicate the possibility of a rather extensive group of perform- 
ances being so nearly related, that they might be gathered together 


as a more or less unitary ability under the concept of "memorization," 


And the point was again emphasized in 1912. Herewith, then, 
was actually encountered something at least akin to the formal 
faculties (ch. iii.) or the types (ch. iv.). 
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After this discovery, such broad factors capable of embracing 
very extensive ranges of ability were placed in the forefront of 
enquiry. There has been a steady stream of investigations in our 
laboratory devoted to ascertaining whether various notable char- 
acters of ability do or do not act as specific factors of broad 
extent. ... 

Overlapping specific factors have since often been spoken of 
as "group factors." They may be defined as those which occur 
in more than one but less than all of any given set of abilities. 
Thus, they indicate no particular characters in any of the abili- 
ties themselves, but only some kinship between those which hap- 
pen to be taken together in a set. Any element whatever in the 
specific factor of an ability will be turned into a group factor, 
if this ability is included in the same set with some other ability 
which also contains this element. The most that can be said is 
that some elements have a broader range than others, and there- 
fore are more likely to play the part of group factors. 
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Three Faces of Intellect 
J. P. GUILFORD 


The last part of th selection from Spearman's book 
oa research finding that has led to а large number of 
vestigations in the decades following Spearman’s 
1920's. The search for group factors, abilities nar- 
but broader than S, became the cen 
in this effort was L. L. Thur. 
гітагу mental abilities 

them. While Thur- 


e foregoing 


points t 
important in 
work of the 
rower in their 5 
tral focus of attention. 
stone, who elaborated the c 


and developed techniq 


stone's reports of his wo 
_ cluded in this book, J. P. Guilford, W. 
of research Thurstone began, has produced a synthesis of ай 
‘complex factor PM ыс results rat сат Serve “аз a defi the 
e structure Of intellect, The Ы 
aper 


theoretical statement about th 
is called “Three Faces of Intellect" and is reprinted f 
c Psychologist, 1959, 14, 469—479. It is reprii rom Ameri- 
permission of the author and the American P; nted with the 
ciation. Introduction and footnotes have pes ge Asso- 
eted. 


rk are 


My subject is in the area of hi i i 
with which the names of TUE Мы ER” in connection 
known the world over. The Stanford Revisio. Ord have become 
telligence scale has been the standard Don of the Binet in- 
instruments for the measurement of intelligenc which all other 
ared. The term IQ or intelligence quotient ARE been com. 

d in this country. This is illustrated by mete а house- 
ола of my neighbors came home es stories, 
‘That Mrs. So-And-So, thinks ioe aPTA 

bout the ‘intelligence quon: AR so 
о: the 


hold wor 

A few years ago, 
meeting, remarking: 
much. She kept talking а 
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children; ‘intelligence quota’; imagine. Why, everybody knows 
that IQ stands for ‘intelligence quiz.’ " 

The other story comes from a little comic strip in a Los An- 
geles morning newspaper, called “Junior Grade." In the first pic- 
ture a little boy meets a little girl, both apparently about the 
first-grade level. The little girl remarks, “I have a high IQ." The 
little boy, puzzled, said, *You have a what?" The little girl re- 
peated, “I have a high IQ," then went on her way. The little boy, 
looking thoughtful, said, *And she looks like such a nice little 
girl, too." 

It is my purpose to speak about the analysis of this thing 
called human intelligence into its components. I do not believe 
that either Binet or Terman, if they were still with us, would 
object to the idea of a searching and detailed study of intelli- 
gence, aimed toward a better understanding of its nature, Pre- 
ceding the development of his intelligence scale, Binet had done 
much research on different kinds of thinking activities and ap- 
parently recognized that intelligence has a number of aspects. It 
is to the lasting credit of both Binet and Terman that they intro- 
duced such a great variety of tasks into their intelligence scales. 

Two related events of very recent history make it imperative 
that we learn all we can regarding the nature of intelligence. I 
am referring to the advent of the artificial satellites and planets 
and to the crisis in education that has arisen in part as a conse- 
quence. Тһе preservation of our way of life and our future secu- 
rity depend upon our most important national resources: our 
intellectual abilities and, more particularly, our creative abilities. 
It is time, then, that we learn all we can about those resources. 


Our knowledge of the components of human intelligence has | 


come about mostly within the last 25 years. The major sources 
of this information in this country have been L. L. Thurstone 
and his associates, the wartime research of psychologists in the 
United States Air Forces, and more recently the Aptitudes Project 
at the University of Southern California, now in its tenth year 
of research on cognitive and thinking abilities. These are mostly 
novel findings. But to me, the most significant outcome has 
been the development of a unified theory of human intellect, 
Which organizes the known, unique or primary intellectual abili- 
ties into a single system called the “structure of intellect.” It is - 
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to this system that I shall devote the major part of my remarks, 
with very brief mentions of some of the implications for the 
psychology of thinking and problem solving, for vocational test- 
ing, and for education. 

Тһе discovery of the components of intelligence has been by 
means of the experimental application of the method of factor 
analysis. It is not necessary for you to know anything about the 
theory or method of factor analysis in order to follow the discus- 
sion of the components. I should like to say, however, that fac- 
tor analysis has no connection with or resemblance to psycho- 
analysis. A. positive statement would be more helpful, so I will 
say that each intellectual component or factor is a unique ability 
that is needed to do well іп a certain class of tasks or tests. As а 

_ general principle we find that certain individuals do well in the 

. tests of a certain class, but they may do poorly in the tests of 
another class. We conclude that a factor has certain properties 

- from the features that the tests of a class have in common. I 

shall give you very soon a number of examples of tests, each 
representing a factor. 


_ THE STRUCTURE OF INTELLECT 


Although each factor is sufficiently distinct to be detected by 
factor analysis, in very recent years it has become apparent that 
the factors themselves сап be classified because they resemble one 
another in certain ways. One basis of classificaton is according 

- to the basic kind of process or operation performed. This kind 
of classification gives us five major groups of intellectual abili- 
ties: factors of cognition, memory, convergent thinking, divergent 
thinking, and evaluation. 

| Cognition means discovery or rediscovery or recognition. 

- Memory means retention of what is cognized. Two Kinds of 

| productive-thinking operations generate new information from 

_ known information and remembered information. In divergent- 

- thinking operations we think in different directions, sometimes 

- searching, sometimes seeking variety. In convergent thinking 
the information leads to one right answer or to a recognized best 

f or conventional answer. In evaluation we reach decisions as to 
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goodness, correctness, suitability, or adequacy of what we know, | 
what we remember, and what we produce in productive think- - 
ing. ) 
А second way of classifying the intellectual factors is according | ; 
to the kind of material or content involved. The factors known 
thus far involve three kinds of material or content: the content. 
may be figural, symbolic, or semantic. Figural content is con- 
crete material such as is perceived through the senses. It does | 
not represent anything except itself. Visual material has properties. 
such as size, form, color, location, or texture. Things we hear or 
feel provide other examples of figural material. Symbolic con- 
tent is composed of letters, digits, and other conventional signs, | 
usually organized in general systems, such as the alphabet or 
the number system. Semantic content is in the form of verbal 
meanings or ideas, for which no examples are necessary. i 

When a certain operation is applied to a certain kind of con- | 
tent, as many as six general kinds of products may be involved. | 
There is enough evidence available to suggest that, regardless | 
of the combinations of operations and content, the same six’ 
kinds of products may be found associated. The six kinds of | 
products are: units, classes, relations, systems, transformations, 
and implications. So far as we have determined from factor 
analysis, these are the only fundamental kinds of products that 
we can know. As such, they may serve as basic classes into 
which one might fit all kinds of information psychologically. | 

The three kinds of classifications of the factors of intellect 
сап be represented by means of a single solid model, shown in | 
Figure 1. In this model, which we call the “structure of intel- 
lect,” each dimension represents one of the modes of d 
of the factors. Along one dimension are found the various kinds 
of operations, along a second one are the various kinds of prod- 
ucts, and along the third are various kinds of content. Along the - 
dimension of content a fourth category has been added, its kind 
of content being designated as “behavioral.” This category has. 
been added on a purely theoretical basis to represent the general 
area sometimes called "social intelligence." More will be said 
about this section of the model later. " 


102 
INTELLIGENCE 


ES 
ov? Е 
ОР; Con, 
с emo P Ten 
Оол; Or 
Digi 7 
Units 
Classes 
2 p 
о Relations Б 
© 
Б Systems 


Transformations 


Implications 


Е 


оу А 
«9% or” 
$3 


E. ubi model representing the stru те о, 
| 741 i 
и f the intellect. 


exploring of it with you systemati ч 
f tests. Each cell in a ub Di giving 
kind of ability that can be described in terms of oi 2 га certain 
tent, and product, for each cell is at the EE E ion: con- 
- combination of kinds of operation, content, and Ex a unique 
for that ability would have the same three ык ЕЧ А test 
oration of the model, we shall take one re In our 
time, beginning with the front face. The first la га layer at a 
with a matrix of 18 cells (if we ignore the BEHAVIOR provides us 
which there are as yet no known factors) each of Sur for 
should 


contain a cognitive ability. 


I shall do some 
кы examples o 


expl 


The Cognitive A bilities 


present the unique abilities that fit lopi 
logically į 
y into 


We know at 
Jls for cognitive abilities. Ea 
. Each 
TOW presents 4 


15 of the 18 ce 


THREE FACES ОЕ INTELLECT 103 


triad of similar abilities, having a single kind of product in com- 
mon. Тһе factors of the first row are concerned with the know- 
ing of units. A good test of the ability to cognize figural units is 
the Street Gestalt Completion Test. Tn this test, the recognition of 
familiar pictured objects in silhouette form is made difficult for 
testing purposes by blocking out parts of those objects. There is 
another factor that is known to involve the perception of auditory 
figures—in the form of melodies, rhythms, and speech sounds— 
and still another factor involving kinesthetic forms. The presence 
of three factors in one cell (they are conceivably distinct abilities, 
although this has not been tested) suggests that more generally, 
in the figural column, at least, we should expect to find more 
than one ability. A fourth dimension pertaining to variations in 
sense modality may thus apply in connection with figural con- 
tent. The model could be extended in this manner if the facts 
call for such an extension. 

The ability to cognize symbolic units is measured by tests like 
the following: 


Put vowels in the following blanks to make real words: 


PAWSR 
M. RV. Т, 
CERTEN 

Rearrange the letters to make real words: 
RACIH 
TVOES 
кгссо 


The first of these two tests is called Disemvoweled Words, and 
the second Scrambled Words. 

The ability to cognize semantic units is the well-known factor 
of verbal comprehension, which is best measured by means of a 
vocabulary test, with items such as: 


GRAVITY means 
CIRCUS means 
VIRTUE means 


From the comparison of these two factors it is obvious that recog- | 


nizing familiar words as letter structures and knowing what words 
mean depend upon quite different abilities. 
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For testing the abilities to know classes of units, we may pre- 
sent the following kinds of items, one with symbolic content and 
one with semantic content: 


Which letter group does not belong? 
XECM PVAA QXIN VTRO 


Which object does not belong? 
clam tree oven rose 


& 


A figural test is constructed in a completely parallel form, present- 
ing in each item four figures, three of which have a property in 
common and the fourth lacking that property. 

The three abilities to see relationships are also readily meas- 
ured by a common kind of test, differing only in terms of content. 
The well-known analogies test is applicable, two items in symbolic 


| and semantic form being: 


r 


|. JIRE : KIRE : : FORA : KORE KORA LIRE GORA GIRE 
poetry : prose : : dance : music walk sing talk jump 


Such tests usually involve more than the ability to cognize rela- 
tions, but we are not concerned with this problem at this point. 
The three factors for cognizing systems do not at present ap- 
pear in tests so closely resembling one another as in the case of 
the examples just given. There is nevertheless an underlying com- 
. mon core of logical similarity. Ordinary space tests, such as 
.. Thurstone's Flags, Figures, and Cards or Part V (Spatial Orienta- 
tion) of the Guilford-Zimmerman Aptitude Survey (GZAS), 
serve in the figural column. The system involved is an order of 
. arrangement of objects in space. A system that uses symbolic 
1 elements is illustrated by the Letter Triangle Test, a sample item 
= of which is: 


"а Ss 


а с і А 
What letter belongs at the place of the question mark? 
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The ability to understand a semantic system has been known 
for some time as the factor called general reasoning. One of its 
most faithful indicators is a test composed of arithmetic-reason- 
ing items. That the phase of understanding only is important for 
measuring this ability is shown by the fact that such a test works 
even if the examinee is not asked to give a complete solution; 
he need only show that he structures the problem properly. For 
example, an item from the test Necessary Arithmetical Operations 
simply asks what operations are needed to solve the problem: 


A city lot 48 feet wide and 149 
feet deep costs $79,432. What 
is the cost per square foot? 


A. add and multiply 
B. multiply and divide 
C. subtract and divide 


D. add and subtract 
E. divide and add 


Placing the factor of general reasoning in this cell of the structure | 
of intellect gives us some new conceptions of its nature, It — 
should be a broad ability to grasp all kinds of systems that are 
conceived in terms of verbal concepts, not restricted to the under- | 
standing of problems of an arithmetical type. E | 
Transformations are changes of various kinds, including modi- - 
fications in arrangement, organization, or meaning. In the figural | 
column for the transformations row, we find the factor known 
as visualization, Common measuring instruments for this factor | 
are the surface-development tests, and an example of a different 
Kind is Part VI (Spatial Visualization) of the GZAS. А test о 
the ability to make transformations of meaning, for the factor 
in the semantic column, is called Similarities. The examinee is | 
asked to state several ways in which two objects, such as an | 
apple and an orange, are alike. Only by shifting the meanings of 
both is the examinee able to give many responses to such an item. 
In the set of abilities having to do with the cognition of impli- | 
cations, we find that the individual goes beyond the information 
given, but not to the extent of what might be called drawing con- | 
clusions, We may say that he extrapolates. From the given in- 
formation he expects or foresees certain consequences, for ex- | 
ample. The two factors found in this row of the cognition matri 
were first called “foresight” factors. Foresight in connection with 
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figural material can be tested by means of paper-and-pencil 
mazes. Foresight in connection with ideas, those pertaining to 
events, for example, is indicated by a test such as Pertinent Ques- 
tions: 


In planning to open a new hamburger stand in a certain com- 
munity, what four questions should be considered in deciding | 
upon its location? 


The more questions the examinee asks in response to a list of 
such problems, the more he evidently foresees contingencies. 


The Memory Abilities 


The area of memory abilities has been explored less than some 
of the other areas of operation, and only seven of the potential 
cells of the memory matrix have known factors in them. These 
cells are restricted to three rows: for units, relations, and systems. 
Тһе first cell in the memory matrix is now occupied by two fac- 
tors, parallel to two in the corresponding cognition matrix: visual 
memory and auditory memory. Memory for series of letters or 
numbers, as in memory span tests, conforms to the conception 
of memory for symbolic units. Memory for the ideas in a para- 
‘graph conforms to the conception of memory for semantic units. 

Тһе formation of associations between units, such as visual 
forms, syllables, and meaningful words, as in the method of 
paired associates, would seem to represent three abilities. to re- 
member relationships involving three kinds of content. We know 
of two such abilities, for the symbolic and semantic columns. 
Тһе memory for known systems is represented by two abilities 
very recently discovered (Christal, 1958). Remembering the аг- 
rangement of objects in space is the nature of an ability in the 
figural column, and remembering a sequence of events is the na- 
ture of a corresponding ability in the semantic column. The dif- 
ferentiation between these two abilities implies that a person may 
be able to say where he saw an object on a page, but he might 
not be able to say on which of several pages he saw it after leaf- 
ing through several pages that included the right one. Considering 
the blank rows in the memory matrix, we should expect to find 
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abilities also to remember classes, transformations, and impli- 
cations, as well as units, relations, and systems. 


The Divergent-Thinking Abilities 


The unique feature of divergent production is that a variety 
of responses is produced. The product is not completely deter- 
mined by the given information. This is not to say that divergent 
thinking does not come into play in the total process of reaching 
a unique conclusion, for it comes into play wherever there is 
trial-and-error thinking. 

The well-known ability of word fluency is tested by asking the 
examinee to list words satisfying a specified letter requirement, 
such as words beginning with the letter "s" or words ending in 
“tion.” This ability is now regarded as a facility in divergent 
production of symbolic units. The parallel semantic ability has 
been known as ideational fluency. A typical test item calls for 
listing objects that are round and edible. Winston Churchill must | 
have possessed this ability to a high degree. Clement Attlee is | 
reported to have said about him recently that, no matter what. 
problem came up, Churchill always seemed to have about ten | 
ideas, The trouble was, Attlee continued, he did not know which | 
was the good one. The last comment implies some weakness in- 
one or more of the evaluative abilities. 1 

The divergent production of class ideas is believed to be the 
unique feature of a factor called "spontaneous flexibility." A typi- 7 
cal test instructs the examinee to, list all the uses he can think of 
for a common brick, and he is given eight minutes. If his responses 
are: build a house, build a barn, build a garage, build a school, - 
build a church, build a chimney, build a walk, and build a ъагЫ 
que, he would earn a fairly high score for ideational fluency but - 
a very low score for spontaneous flexibility, because all these | 
uses fall into the same class. If another person said: make a door | 
Stop, make a paper weight, throw it at a dog, make a bookcase, 4 
drown а cat, drive а пай, make а red powder, and use for base- 
ball bases, he would also receive a high score for flexibility. He 
has gone frequently from one class to another. 

A current study of unknown but predicted divergent-production 
abilities includes testing whether there are also figural апы 5 
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bolic abilities to produce multiple classes. An experimental figural 
test presents a number of figures that can be classified in groups 
of three in various ways, each figure being usable in more than 
one class. An experimental symbolic test presents a few numbers 
that are also to be classified in multiple ways. 

A unique ability involving relations is called “associational flu- 
ency." It calls for the production of a variety of things related in 
a specified way to a given thing. For example, the examinee is 
asked to list words meaning about the same as “good” or to list 
words meaning about the opposite of “hard.” In these instances 
the response produced is to complete a relationship, and semantic 
content is involved. Some of our present experimental tests call 
for the production of varieties of relations, as such, and involve 
figural and symbolic content also. For example, given four small 
digits, in how many ways can they be related in order to produce 
a sum of eight? 

2 One factor pertaining to the production of systems is known as 
. expressional fluency. The rapid formation of phrases or sentences 
_ is the essence of certain tests of this factor. For example, given 
І the initial letters: 


| 


W. с. е p 


with different sentences to be produced, the examinee might 
- write “We can eat nuts" or “Whence came Eve Newton?" In 
interpreting the factor, we regard the sentence as a symbolic 
_ system. By analogy, a figural system would be some kind of 
- organization of lines and other elements, and a semantic system 
"would be in the form of a verbally stated problem or perhaps 
_ something as complex as a theory. 

Іп the row of the divergent-production matrix devoted to trans- 
- formations, we find some very interesting factors. The one called 
к “adaptive flexibility” is now recognized as belonging in the figural 
column. A faithful test of it has been Match Problems. This is 
"based upon the common game that uses squares, the sides of 
which are formed by match sticks. The examinee is told to take 
away a given number of matches to leave a stated number of 
squares with nothing left over. Nothing is said about the sizes of 
the squares to be left. If the examinee imposes upon himself the 
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restriction that the squares that he leaves must be of the same 

` size, he will fail in his attempts to do items like that in Figure 2. 
Other odd kinds of solutions are introduced in other items, such 
as overlapping squares and squares within squares, and so on. In 
another variation of Match Problems the examinee is told to 
produce two or more solutions for each problem. 


Item from the test match problems 


Take away four matches in А, leaving 
three squares and nothing more. Answer: 5. 


Fig. 2. A sample item from the test Match Problems. The problem 
in this item is to take away four matches and have three squares. 
The solution is given. 


А factor that has been called "originality" is now recognized 
as adaptive flexibility with semantic material, where there must. 
be a shifting of meanings. The examinee must produce the shifts 
or changes in meaning and so come up with novel, unusual, 
clever, or farfetched ideas. The Plot Titles Test presents a sho 
story, the examinee being told to list as many appropriate titles 
as he can to head the story. One story is about a missionary who 
has been captured by cannibals in Africa. He is in the pot and 
about to be boiled when a princess of the tribe obtains a promise 
for his release if he will become her mate. He refuses and is 
boiled to death. v 

In scoring the test, we separate the responses into two cate- 
gories, clever and nonclever. Examples of nonclever response: 
are: African Death, Defeat of a Princess, Eaten by Savages. 
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The Princess, The African Missionary, In Darkest Africa, and 
Boiled by Savages. These titles are appropriate but commonplace. 
Тһе number of such responses serves as a score for ideational 
fluency. Examples of clever responses are: Pot's Plot, Potluck 
Dinner, Stewed Parson, Goil or Boil, A Mate Worse than Death, 
He Left a Dish for a Pot, Chaste in Haste, and A Hot Price for 
Freedom. The number of clever responses given by an examinee 
is his score for originality, or the divergent production of semantic 

- transformations. 
Another test of originality presents a very novel task so that 
_ any acceptable response is unusual for the individual. In the 
Symbol Production Test the examinee is to produce a simple 
. symbol to stand for a noun or a verb in each short sentence, in 
_ other words to invent something like pictographic symbols. Still 
another test of originality asks for writing the "punch lines" for 
2 cartoons, a task that almost automatically challenges the examinee 
to be clever. Thus, quite a variety of tests offer approaches to the 


. measurement of originality, including one or two others that I 
have not mentioned. 

3 Abilities to produce a variety of implications are assessed by 
tests calling for elaboration of given information. A figural test 
of this type provides the examinee with a line or two, to which he 

is to add other lines to produce an object. The more lines he 

. adds, the greater his score. A semantic test gives the examinee the 

_ outlines of a plan to which he is to respond by stating all the de- 

tails he can think of to make the plan work. A new test we are 

trying out in the symbolic area presents two simple equations 
such as B — C = D and z = А + D. The examinee is to make as 

, many other equations as he can from this information, 


The Convergent-Production Abilities 


Of the 18 convergent-production abilities expected in the three 
_ content columns, 12 are now recognized. In the first row, per- 
. taining to units, we have an ability to name figural properties 

(forms or colors) and ап ability to name abstractions (classes. 
relations, and 50 оп). It may be that the ability in common to (ДЕ 
speed of naming forms and the speed of naming colors is not 
appropriately placed in the convergent-thinking matrix. One 
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might expect that the thing to be produced in a test of the con- 
vergent production of figural units would be in the form of figures 
rather than words. A better test of such an ability might some- 
how specify the need for one particular object, the examinee to 
furnish the object. 

A test for the convergent production of classes (Word Group- 
ing) presents a list of 12 words that are to be classified in four, 
and only four, meaningful groups, no word to appear in more | 
than one group. A parallel test (Figure Concepts Test) presents | 
20 pictured real objects that are to be grouped in meaningful 
classes of two or more each. 

Convergent production having to do with relationships is repre- | 
sented by three known factors, all involving the “eduction of 
correlates,” as Spearman called it. The given information in- 
cludes one unit and a stated relation, the examinee to supply | 
the other unit. Analogies tests that call for completion rather 
than a choice between alternative answers emphasize this kind of 
ability. With symbolic content such an item might read: 


pots stop bard drab rats .? 
А semantic item that measures eduction of correlates is: 
Тһе absence of sound is 


Incidentally, the latter item is from a vocabulary-completion 
test, and its relation to the factor of ability to produce correlates 
indicates how, by change of form, a vocabulary test may indicate 
an ability other than that for which vocabulary tests are usually | 
intended, namely, the factor of verbal comprehension. 

Only one factor for convergent production of systems is 
known, and it is in the semantic column. It is measured by a class | 
of tests that may be called ordering tests. The examinee may be 
presented with a number of events that ordinarily have a best or 
most logical order, the events being presented i in scrambled order. 
The presentation may be pictorial, as in the Picture Arrangement 
Test, or verbal. The pictures may be taken from a cartoon strip. 
The verbally presented events may be in the form of the various 
steps needed to plant a new lawn. There are undoubtedly ote 
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kinds of systems than temporal order that could be utilized for 
testing abilities in this row of the convergent-production matrix. 
In the way of producing transformations of a unique variety, 
we have three recognized factors, known as redefinition abilities. 
In each case, redefinition involves the changing of functions or 
“uses of parts of one unit and giving them new functions or uses 
in some new unit. For testing the ability of figural redefinition, a 
task based upon the Gottschaldt figures is suitable. Figure 3 
- shows the kind of item for such a test. In recognizing the simpler 
| figure within the structure of а more complex figure, certain lines 
must take on new roles. 


Item 1 Item2 


Fig. 3. Sample items from a test Hidden Figure, based upon the 
Gottschaldt figures. Which of the simple figures is concealed within 
each of the two more complex figures? 


. In terms of symbolic material, the following sample items will 
ustrate how groups of letters in given words must be readapted 
to use in other words. In the test Camouflaged Words, each 
entence contains the name of a sport or game: 


I did not know that he was ailing. 
To beat the Hun, tin goes a long way. 


or the factor of semantic redefinition, the Gestalt Transforma- 
on Test may be used. A sample item reads: 


From which object could you most likely make a needle? 
А. a cabbage 
B. a splice 


т 
“ҡ.. 1 
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C. a steak 
D. a paper box 
E. a fish 


The convergent production of implications means the drawing 
of fully determined conclusions from given information. The 
well-known factor of numerical facility belongs in the symbolic 
column. For the parallel ability in the figural column, we have a 
test known as Form Reasoning, in which rigorously defined opera- 
tions with figures are used. For the parallel ability in the seman- 
tic column, the factor sometimes called “deduction” probably 
qualifies. Items of the following type are sometimes used. 


Charles is younger than Robert 
Charles is older than Frank 
Who is older: Robert or Frank? 


Evaluative Abilities 


| 
a 
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k 
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The evaluative area has had the least investigation of all the 
operational categories. In fact, only one systematic analytical | 
study has been devoted to this area. Only eight evaluative abili- 
ties are recognized as fitting into the evaluation matrix. But at 
least five rows have one or more factors each, and also three of 
the usual columns or content categories. In each case, evaluation 
involves reaching decisions as to the accuracy, goodness, suita- 
bility, or workability of information. In each row, for the particu- 
lar kind of product of that row, some kind of criterion or stand- 
ard of judgment is involved. 

In the first row, for the evaluation of units, the important de- | 
cision to be made pertains to the identity of a unit. Is this unit 
identical with that one? In the figural column we find the factor 
long known as “perceptual speed.” Tests of this factor invariably 
call for decisions of identity, for example, Part IV (Perceptual 
Speed) of the GZAS or Thurstone’s Identical Forms. I think 
it has been generally wrongly thought that the ability involved is. 
that of cognition of visual forms. But we have seen that another 
factor is a more suitable candidate for this definition and for be- 
ing in the very first cell of the cognitive matrix. It is parallel em 
Ht 
D. 
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this evaluative ability but does not require the judgment of 
identity as one of its properties. 
In the symbolic column is an ability to judge identity of sym- 
bolic units, in the form of series of letters or numbers or of 
. names of individuals. 


Are members of the following pairs identical or not: 
82517043: 825176493 
dkeltumpa ——  dkeltvmpa 

ny C. S. Meyerson______C. Е. Meyerson 


Such items are common in tests of clerical aptitude. 
l There should be a parallel ability to decide whether two ideas 
are identical or different. Is the idea expressed in this sentence the 
. same as the idea expressed in that one? Do these two proverbs 
express essentially the same idea? Such tests exist and will be 
‘used to test the hypothesis that such an ability can be demon- 
= strated. 
No evaluative abilities pertaining to classes have as yet been 
_ recognized. The abilities having to do with evaluation where re- 
. lations are concerned must meet the criterion of logical con- 
Ч sistency. Syllogistic-type tests involving letter symbols indicate a 
- different ability than the same type of test involving verbal state- 
ments. In the figural column we might expect that tests incorpo- 
rating geometric reasoning or proof would indicate a parallel 
ability to sense the soundness of conclusions regarding figural 
relationships. 
Тһе evaluation of systems seems to be concerned with the in- 
ternal consistency of those systems, so far as we can tell from 
the knowledge of one such factor. The factor has been called 
"experiential evaluation," and its representative test presents 
items like that in Figure 4 asking "What is wrong with this 
picture?" The things wrong are often internal inconsistencies, 
verti abiliy for evaluating transformations i thought to 
л 2 judgment." In typical judgment 
tests, the examinee is asked to tell which of five solutions to a 
P practical problem is most adequate or wise. The solutions fre- 
quently involve improvisations, in other words, adaptations of 
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Fig. 4. 


familiar objects to unusual uses. In this way the items present 
redefinitions to be evaluated. 

А factor known first as "sensitivity to problems" has become 
recognized as an evaluative ability having to do with implications. 
One test of the factor, the Apparatus Test, asks for two needed 
improvements with respect to each of several common devices, 
such as the telephone or the toaster. The Social Institutions Test, 
a measure of the same factor, asks what things are wrong with 
each of several institutions, such as tipping or national elections. 
We may say that defects or deficiencies are implications of an 
evaluative kind. Another interpretation would be that seeing de- 
fects and deficiencies are evaluations of implications to the effect 
that the various aspects of something are all right. 


SOME IMPLICATIONS OF THE STRUCTURE 
OF INTELLECT 


For Psychological Theory 


Although factor analysis as generally employed is best designed 
to investigate ways in which individuals differ from one another, 
in other words, to discover traits, the results also tell us much 
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about how individuals are alike. Consequently, information re- 
garding the factors and their interrelationships gives us under- 
standing of functioning individuals. The five kinds of intellectual 
‘abilities in terms of operations may be said to represent five ways 
. of functioning. The kinds of intellectual abilities distinguished 
according to varieties of test content and the kinds of abilities 
distinguished according to varieties of products suggest a classifi- 
cation of basic forms of information or knowledge. The kind of 
organism suggested by this way of looking at intellect is that of 
_ ап agency for dealing with information of various kinds in vari- 
ous ways. The concepts provided by the distinctions among the 
. intellectual abilities and by their classifications may be very use- 
ful in our future investipations of learning, memory, problem 
solving, invention, and decision making, by whatever method we 


Г choose to approach those problems. 
| 


І 


1 For Vocational Testing 


$ 


With about 50 intellectual factors already known, we may say 
that there are at least 50 ways of being intelligent. It has been 
A facetiously suggested that there seem to be a great many more 
М ways of being stupid, unfortunately. The structure of intellect is 
a theoretical model that predicts as many as 120 distinct abilities, 
if every cell of the model contains a factor. Already we know that 
| two cells contain two or more factors each, and there probably 
" are actually other cells of this type. Since the model was first 
conceived, 12 factors predicted by it have found places in it. 
There is consequently hope of filling many of the other vacancies, 
and we may eventually end up with more than 120 abilities. 

The major implication of the assessment of intelligence is that 
to know an individual's intellectual resources thoroughly we 
shall need a surprisingly large number of scores. It is expected 
that many of the factors are intercorrelated, so there is some 
- possibility that by appropriate sampling we shall be able to 
cover the important abilities with a more limited number of 
tests. At any rate, a multiple-score approach to the assessment of 


intelligence is definitely indicated in connection with future vo- 
_ cational operations. 


OA 
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Considering the kinds of abilities classified as to content, we 
may speak roughly of four kinds of intelligence. The abilities in- 
volving the use of figural information may be regarded as “соп- 
crete" intelligence. The people who depend most upon these 
abilities deal with concrete things and their properties. Among 
these people are mechanics, operators of machines, engineers (in 
some aspects of their work), artists, and musicians. 

In the abilities pertaining to symbolic and semantic content, 
we have two kinds of "abstract" intelligence. Symbolic abilities 
should be important in learning to recognize words, to spell, and 
to operate with numbers. Language and mathematics should 
depend very much upon them, except that in mathematics some 
aspects, such as geometry, have strong figural involvement. Se- 
mantic intelligence is important for understanding things in terms. 
of verbal concepts and hence is important in all courses where 
the learning of facts and ideas is essential. 

In the hypothesized behavioral column of the structure of | 
intellect, which may be roughly described as “social” intelligence, | 
we have some of the most interesting possibilities. Understanding 
the behavior of others and of ourselves is largely nonverbal in 
character. The theory suggests as many as 30 abilities in this 
area, some having to do with understanding, some with produc- | 
tive thinking about behavior, and some with the evaluation of | 
behavior. The theory also suggests that information regarding 
behavior is also in the form of the six kinds of products that apply 
elsewhere in the structure of intellect, including units, relations, 
systems, and so on. The abilities in the area of social intelligence, 
whatever they prove to be, will possess considerable importance | 
in connection with all those individuals who deal most with other 
people: teachers, law officials, social workers, therapists, poli- 
ticians, statesmen, and leaders of other kinds. 


For Education 


The implications for education are numerous, and I have time | 
just to mention a very few. The most fundamental implication is 
that we might well undergo transformations with respect to OUT - 
conception of the learner and of the process of learning. Under 
the prevailing conception, the learner is a kind of stimulus-re- | 
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' sponse device, much on the order of a vending machine. You 

put in a coin, and something comes out. The machine learns 
what reaction to put out when a certain coin is put in. If, in- 
stead, we think of the learner as an agent for dealing with infor- 
mation, where information is defined very broadly, we have 
something more analogous to an electronic computer. We feed 
a computer information; it stores that information; it uses that 
information for generating new information, either by way of 
divergent or convergent thinking; and it evaluates its own results. 
Advantages that a human learner has over a computer include 
the step of seeking and discovering new information from 
sources outside itself and the step of programing itself. Perhaps 
еуеп these steps will be added to computers, if this has not al- 
ready been done in some cases. 

At any rate, this conception of the learner leads us to the idea 
that learning is discovery of information, not merely the formation 
of associations, particularly associations in the form of stimulus- 
response connections, I am aware of the fact that my proposal 
is rank heresy. But if we are to make significant progress in our 
understanding of human learning and particularly our under- 
standing of the so-called higher mental processes of thinking, 
problem solving, and creative thinking, some drastic modifications 
are due in our theory. 

Тһе idea that education is a matter of training the mind or of 
training the intellect has been rather unpopular, wherever the 
prevailing psychological doctrines have been followed. In theory, 
at least, the emphasis has been upon the learning of rather spe- 
cific habits or skills. If we take our cue from factor theory, how- 
ever, we recognize that most learning probably has both specific 
and general aspects or components. The general aspects may be 
along the lines of the factors of intellect. This is not to say that 
the individual’s status in each factor is entirely determined by 
learning. We do not know to what extent each factor is deter- 
mined by heredity and to what extent by learning. The best 
position for educators to take is that possibly every intellectual 
factor can be developed in individuals at least to some extent by 
learning. 


If education has the general objective of developing the intel- 
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lects of students, it can be suggested that each intellectual factor 
provides a particular goal at which to aim. Defined by a certain 
combination of content, operation, and product, each goal ability 
then calls for certain kinds of practice in order to achieve im- 
provement in it. This implies choice of curriculum and the choice 
or invention of teaching methods that will most likely accom- 
plish the desired results. 

Considering the very great variety of abilities revealed by the 
factorial exploration of intellect, we are in a better position to 
ask whether any general intellectual skills are now being neglected 
in education and whether appropriate balances are being ob- 
served. It is often observed these days that we have fallen down 
in the way of producing resourceful, creative graduates. How true 
this is, in comparison with other times, I do not know. Perhaps 
the deficit is noticed because the demands for inventiveness are 
so much greater at this time. At any rate, realization that the 
more conspicuously creative abilities appear to be concentrated 
in the divergent-thinking category, and also to some extent in 
the transformation category, we now ask whether we have been 
giving these skills appropriate exercise. It is probable that we 
need a better balance of training in the divergent-thinking area 
as compared with training in convergent thinking and in critical 
thinking or evaluation. 

Тһе structure of intellect as I have presented it to you may or 
may not stand the test of time. Even if the general form persists, 
there are likely to be some modifications. Possibly some different 
kind of model will be invented. Be that as it may, the fact of а 
multiplicity of intellectual abilities seems well established. 

There are many individuals who long for the good old days 
of simplicity, when we got along with one unanalyzed intelli- 
gence. Simplicity certainly has its appeal. But human nature is 
exceedingly complex, and we may as well face that fact. The 
rapidly moving events of the world in which we live have forced. 
upon us the need for knowing human intelligence thoroughly. 
Humanity's peaceful pursuit of happiness depends upon our 
control of nature and of our own behavior; and this, in turn, 
depends upon understanding ourselves, including our intellectual 
resources. 
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The Study of Giftedness: 
A Multidimensional Approach 


J. W. GETZELS AND P. W. JACKSON 


During the 1950's and 1960's increasing attention has been 
focused on the question of whether creativity is a characteristic 
different from and independent of intelligence as usually tested. 
One widely discussed investigation was that of J. W. Getzels and 
P. W. Jackson. They reported their results in full in book form, 
but a brief account of what they did and what they found was 
published in the paper from which portions are reprinted here. 
The reference is “Тһе Study of Giftedness: А Multidimensional 
Approach," in The Gifted Student, OE-35016, Cooperative Re- 
search Monograph No. 2. The sections below are from pages 
6-18. They are reprinted with the authors’ permission. 


THE HIGHLY CREATIVE AND THE HIGHLY 
INTELLIGENT ADOLESCENT: 4n Attempt to 
Differentiate Two Types of Giftedness 


Although few would argue that the terms "creative" and "in- 
telligent" refer to independent classes of phenomena, still fewer 
would seriously propose that the two terms are synonymous. De- 
spite this recognition of relative independence at the theoretical 
level, when turning to practical problems involving the assess- 


ment of the two qualities, one finds that the well-established іп- 


telligence test is most frequently used as the indicator of creativity. 
Individuals are grouped by IQ, and generally there is disappoint- 
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ment if the high-IQ person is not also creative. Sometimes he is 
not. There is also bewilderment when the creative individual has 
a relatively low IQ, as is often the case. Theoretical issues in the 
study of higher cognitive functioning and current practical prob- 
lems in the search for talent make the importance of differenti- 
ating the two concepts in empirical terms self-evident. 


Problem 


Тһе central purpose of this research is to discover significant 
variables differentiating the creative from the intelligent person. 
Specifically, the present study examines the achievement motives, 
fantasy productions, school performance, and teacher preferences 
of two types of adolescents: those exceptionally high in creativity 
but not in IQ, and those exceptionally high in IQ, but not in 
creativity. 


Subjects, Instruments, and Procedures 


Тһе subjects were drawn from 449 adolescents comprising 
the total population of a midwestern private secondary school. 
The experimental groups were composed on the basis of per- 
formance on the following tests: 

Standard IQ tests.—A. Stanford-Binet, a WISC, or a Henmon- 
Nelson score was available for each adolescent. The scores ob- 
tained from the WISC and the Henmon-Nelson were converted 
by regression equation to comparable Stanford-Binet IQ's. 

Five creativity tests taken or adapted from Guilford and Cattell 
or constructed especially for the study: 


1. Wonp Association. The subject was asked to give as many 
definitions as possible to fairly common stmulus-words; e.g., 
“bolt,” “bark,” “sack.” His score depended upon the abso- 
lute number of definitions and the number of different cate- 
gories into which these definitions could be put. 

2. UsEs For Тнімсв. The subject w; 
uses as he could for objects that 
typed function attached to them; 
His score depended upon both t 
of the uses he mentioned. 


as required to give as many 
customarily have a stereo- 
6.8., “brick,” “paperclip.” 
he number and originality 


' 
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3. 


HIDDEN SHaPEs. The subject was required to find a given 
geometric form that was hidden in more complex geometric 
forms or patterns. 

FABLES. The subject was presented with four fables in 
which the last lines were missing. He was required to com- 
pose three different endings for each fable: a “moralistic,” 
а "humorous," and a "sad" ending. His score depended 
upon the number, appropriateness, and originality of the 
endings. 


- MAKE-UP PROBLEMS. The subject was presented with four 


complex paragraphs, each of which contained a number of 


numerical statements; e.g., "the costs involved in building | 
a house." He was asked to make all the mathematical prob- | 


lems he could that might be solved with the information. 
given. His score depended upon the number, appropriate~ 


ness, and originality of the problems. 


К 


On the basis of the IQ measure and the mean of the five cre- - 
ativity measures, two experimental groups were formed: 


J 


The high creativity group (26 students: 15 boys, 11 girls) 
— students in the top 20 percent in creativity, compared to 
students of the same age and sex, but not in the top 20 per- 
cent in IQ. 


. The high intelligence group (28 students: 17 boys, 11 girls) 


—students in the top 20 percent in IQ, compared with stu- 
dents of the same age and sex, but not in the top 20 percent 
in creativity. > 


Тһе two groups were then compared to each other and to the 
population from which they were drawn on the following vari- 


ables: School performance as measured by standardized verbal. 


and numerical achievement tests appropriate to each grade level; 
teacher preferences on having them in class; N-Achievement as 


measured by conventional scoring of responses to six of Mc- 
Clelland's stimulus-pictures. In addition to the conventional scor- - 
ing, the N-Achievement protocols were also sorted “blind” for | 


the creative and a matched noncreative group and finally ana- 
lyzed systematically for the creative and intelligent groups by | 
categories suggested in the blind sorting. 


РЕЧКУ" 
124 INTELLIGENCE 


Results 


Тһе results (see Tables 1 and 2) may be summarized as fol- 
lows: (1) Despite the striking differences in mean IQ, the crea- 
tive and the intelligent groups were equally superior to the total 
population in school performance as measured by standardized 
achievement tests. (2) Although it might be expected that crea- 
tivity would contribute to status in a school setting, especially 
since the achievement of the highly creative subjects was at 


TABLE 1 


Means and Standard Deviations of Highly Creative and 
Highly Intelligent Groups on Experimental Variables 


Total High 
population! High-IQ creati ve? 
Variables (N = 449) (N=28) (N-24 
1 2 а) 4 
10 
Меап 132.00 150.00%% 127.00 
Standard deviation 15.07 6.64 10.58 
School achievement 
Mean 49.91 55.00** 56.27%% 
Standard deviation 7.36 5.95 7.90 
Teacher preference ratings 
Mean 10.23 11.20* 10.54 
Standard deviation 3.64 1.56 1.95 
Need for achievement 
(T.-scores): 
Mean 49.81 49.00 50.04 
Standard deviation 9.49 7.97 8.39 


! For purposes of comparison the scores of each experimental group 
were extracted from the total population before r-tests were computed. 
? Two subjects were omitted from the sample of 26 high creatives because 
because they failed to furnish data on the McClelland N-Achievement 
instrument. 
* Significant at 0.01 level. 
** Significant at 0.001 level. 
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least as good as that of the highly intelligent subjects, it was 
actually the intelligent group rather than the creative group that 
was preferred by teachers when compared with the average stu- 
dent. (3) The two groups did nor differ from the population in 


N-Achievement as scored conventionally. (4) Although failing | 


to show differences when scored for N-Achievement, the fantasy 
productions of the creative group were clearly dissimilar from 
those of the population as a whole, so much so that the “blind” 
sorting of 47 creative and noncreative protocols resulted in only’ 
7 misplacements, (5) A more systematic differentiation of the 
protocols using content-analysis procedures showed that the two 


sponses. The creative group made greater use of stimulus-free | 
themes, unexpected endings, humor, incongruities, and playful- 


ness. 
Here, for example, are typical stories by highly intelligent and 
by highly creative subjects to two of the McClelland stimulus- 


pictures. 
TABLE 2 


Categories of Fantasy Production of Highly Creative 
and Highly Intelligent Groups 


experimental groups differed significantly in their fantasy re- | 


М 


Group | 
High creativity! High IQ | 
(№ = 24) (N = 28) 
Content-analysis ы 
categories Frequency? Percent Frequency? Percent xt 
1 2 3 4 5 s M 
Stimulus-free theme 18 15 m 39 ET Ж 
Unexpected ending 22 92 17 61 5.05* À 
Presence of humor 17 71 7 25 9.16%% 
Presence of incongruity 17 71 10 36 5.06% 
Presence of violence 18 75 13 46 327 
Playful attitude toward 
theme 21 89 9 32 14.04** 


1 Two subjects were omitted from the sample of 26 High Creatives because they failed _ 
to furnish data on the McClelland N-Achievement instrument. 

? Numbers in the frequency column represent the subjects whose fantasy productions | 
fit the corresponding categories. 

3 Yates correction was applied in the computation of chi-squares. 

* Significant at the 0.05 level. 

** Significant at the 0.01 level. 
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One picture-stimulus was perceived most often as a man in an 
airplane reclining seat returning from a business trip or con- 
ference. A high-IQ subject gave the following story: *Mr. Smith 
is on his way home from a successful business trip. He is very 
happy and he is thinking about his wonderful family and how 
glad he will be to see them again. He can picture it, about an 
hour from now, his plane landing at the airport and Mrs. Smith 
and their three children all there welcoming him home again." 
A high-creative subject wrote this*story: “This man is flying 
Баск from Reno where he has just won a divorce from his wife. 
Не couldn't stand to live with her anymore, he told the judge, 
_ because she wore so much cold cream on her face at night that 

her head would skid across the pillow and hit him in the head. He © 
is now contemplating a new skid-proof face cream.” 

This story was in response to a stimulus-picture usually per- 
ceived as a man working late (or very early) in an office: 


THE HIGH IQ STUDENT: "There's ambitious Bob, down at the of- 
fice at 6:30 in the morning. Every morning it's the same. He's trying 
to show his boss how energetic he is. Now, thinks Bob, maybe the 
boss will give, те a raise for all my extra work. The trouble is that 
Bob has been doing this for the last three years, and the boss still 
hasn't given him a raise. He'll come in at 9:00, not even noticing 
that Bob had been there so long, and poor Bob won't Bet his raise." 

THE HiGH-CREATIVE STUDENT: "This man has just broken into this 
office of a new cereal company. He is a private-eye employed by a 
competitor firm to find out the formula that makes the cereal bend, 
sag, and sway. After a thorough search of the office he comes upon 
what he thinks is the correct formula. He is now copying it. It turns 
out that it is the wrong formula and the competitor's factory blows 
up. Poetic justice!" 


These stories were written in group sessions with often more 
than a hundred adolescents in the same room and a maximum 
writing time four minutes per story. "Skidproof face cream!" 
"Cereal that will bend, sag, and sway!" It seems that the ability 
to restructure stereotyped objects with ease and rapidity—almost 
"naturally"—is the characteristic mark of the high creative as 
against the high IQ subjects in this investigation. 
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The essence of creativity appears to lie in the ability to pro- | 
duce new forms, to conjoin elements that are customarily thought | 
of as independent or dissimilar; not merely the propensity for 
seeing the bizarre but rather the aptitude for achieving new : 
meanings having social value. Guilford has given the name “di- 
vergent” to intellectual activities expressing this ability, in con 
trast to activities which he calls "convergent." It is chiefly the. 
latter type of performance that is tapped by conventional meas- - 
ures of intelligence. Whether or not one adopts the terminology 
of Guilford, there is little doubt that the ability required for what 
has been called "divergent" intellectual activity is not well 
sampled by the usual intelligence-test items, and accordingly this 
ability contributes but little to the IQ score. In these terms, the 
high IQ subjects of the experimental groups are superior in 
"convergent" intellectual performance and the high-creativity 
subjects in "divergent" intellectual performance. 

The evidence of this report centers attention on the difference 
in the fantasy quality of the two groups. It is tentatively con- 
cluded that a sine qua non of creative functioning is a rich and 
available fantasy life. 

The difference between the person with a convergent and the 
person with a divergent orientation toward problem solving ap- 
pears to be that the former focuses on the stimulus, since he 
Seeks objective precision of the sort others will recognize as 
"right" and therefore successful by conventional standards. In 
effect, he may be said to intellectualize the ambiguities presented 
by a problem in an effort to find the right answer. The latter 
detaches himself from the stimulus, since he prefers subjective 
playfulness that he himself will find “delightful.” In effect, he 
may be said to personalize the ambiguities presented by a problem 
in an effort to attain an enjoyment which may or may not be 
shared with others. If the former “latches on” to a stimulus, the 
latter “takes off” from a stimulus. 

The search for variables differentiating the “creative” from 
the “intelligent” person is the focus of much theoretical and 
Practical concern. This study examined the achievement motives, 
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fantasy productions, school performance, and teacher prefer- 
ences of two types of adolescents, those exceptionally high in 
creativity but not in IQ and those exceptionally high in IQ but 
not in creativity. The results indicated that: (1) Despite striking 
differences in IQ, the two groups were equally superior in school 
achievement; (2) The intelligent subjects rather than the creative 
ones were preferred by teachers; (3) There were no differences 
in N-Achievement; (4) There were significant differences in fan- 
tasy productions, the creative group using more stimulus-free, 
humorous, and playful themes. 


OCCUPATIONAL CHOICE AND COGNITIVE 
FUNCTIONING: A Study of the Career 
Aspirations, of Highly Intelligent and 

of Highly Creative Adolescents 


. Тһе relationship between an individual's cognitive style and 
| his personal orientation to the world is of central importance to 
. the understanding of both cognitive functioning and social be- 
. havior. This study investigates the relationship between cognition, 

as defined by performance on intellective tasks, and personal 


orientation, as defined by long-term occupational choice and 
career aspiration. 


Problem 


The purpose of the investigation is two-fold: At the substantive 

- level, to determine the occupational preferences of the two groups 

of adolescents described in the previous section; at the theoretical 

level, to ascertain the relationship between types of cognition 

‘апа types of career aspiration. Two guiding empirical questions 

were posed: (1) What is the nature of the long-term occupational 

goals of the two groups? (2) To what extent do perceived “teacher 

_ standards" and the criterion "success in adult life” enter as mo- 
tives in the aspirations of the two groups? 


Line 
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The experimental groups were the 26 highly creative and the 
28 highly intelligent adolescents previously described. Four instru- 
ments were used to obtain the data: 


A DIRECT SENTENCE COMPLETION TEST. Among 
the 60 items comprising this test were such career-preference 
items as: “When I grow up І want to become a... ," “If — 
the choice of a permanent occupation were left up to me, I 
would choose . . . ," “The work that has the greatest appeal - 
to me is... ," "I always wanted to be a.. ." The stu- 
dent was required to respond directly to these items by com- 
pleting each stub so as to reflect his own preferences. The 
responses of the two groups were analyzed for the number and 
kind of occupations mentioned. 

AN INDIRECT SENTENCE COMPLETION TEST. This 
test was parallel to the direct test, except that the sentence 
stubs were written in the third person and used boys' names for 
the male subjects and girls’ names for the female subjects: 
“When Stan [Jean] grows up, he [she], wants to become a 

. ," etc, The subject was required to respond "projectively" | 
to the items by completing the stubs as a verbal speed test. | 
The responses of the two groups were analyzed for the number | 
and kind of occupations mentioned. 3 

А PARENT QUESTIONNAIRE. This instrument required | 
the parents of the students to respond to two questions regard- 
ing their children's occupational goals as follows: “Наз the 
pupil expressed interest in a particular career?” “If yes, specify. 
. . .” The responses from the parents of the two groups were + 
analyzed for the number and kind of occupations mentioned. À 

AN OUTSTANDING TRAITS TEST. This was the same | 
test described in detail in the first section. It contained de- 1 

Й 


scriptions of 13 children, each description exemplifying some 
desirable personal quality or trait. The subjects were required to 
rank the 13 hypothetical children in 3 ways: (1) On the de- 
gree to which they would like to be like them; (2) On the 
degree to which they believed teachers would like them; (3) A 
5 


4 
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On the degree to which they believed people with these quali- 
ties would succeed in adult life. The rankings given by the two 
groups within each category and the relationships among the 
rankings for the different categories were analyzed. 


Summary of Results 


1. Differences between the two groups appeared in both the 
quantity and quality of occupational goals. The quantity of occu- 
pational possibilities mentioned is significantly greater for the 
high creatives than for the high IQ's, the latter group having 
mentioned an average of 1.82 different occupations on the Direct 
Sentence Completion Test and 3.57 on the Indirect Test, the 
former group an average of 2.61 and 5.00 on the respective tests. 
The quality of the different occupations mentioned as possibilities 
is also significantly different for the two groups. When the occu- 
pations mentioned were divided into conventional (lawyer, doc- 
tor, professor) and unconventional (adventurer, inventor, writer) 
categories, it was found that the high creatives mentioned a sig- 
nificantly greater proportion of unconventional occupations than 
did the high IQ's. For example, on the Direct Sentence Comple- 
tion Test, only 18 percent of the high IQ's mentioned any un- 
conventional occupation, whereas 62. percent of the high creatives 
mentioned at least one such Occupation as a possibility. (See 
Table 3.) 

The findings of the reports of the adolescents are supported by 
the data from the Parent Questionnaire. Parents of 24 of the 
high-IQ children and 24 of the high-creativity children replied to 
the questionnaire. Parents of 16 high-IQ and 20 high-creativity 
children reported that their children had expressed an interest in 
some career. What is most noteworthy in these reports is that 12 
(75 percent) of the parents of high-IQ children mentioned Occu- 
pations in but five career categories: engineering and architecture, 
science, medicine, law, and teaching; only 7 (35 percent) of the 
parents of high-creativity children mentioned career choices ex- 
clusively in these five categories. Instead, the parents of high-crea- 
tivity children tended to mention such rather unconventional oc 
cupations as “veterinary” or "entertainer," such unresolved com 
binations as “law or music,” “teaching or art," and such expressive 
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professions as “writing” or “dancing.” None of the latter were 
mentioned as possibilities by the parents of the high-IQ children. 
A summary of the data is presented in table 4. 


TABLE 4 


i Career Choices Mentioned by Parents 
of High-IQ and High-creative Adolescents 


Parents of— 


High-IQ’s High-creatives 
Career choice mentioned (М - 16) (N = 20) 


A single major profession such as 
engineering or architecture, law, 


medicine, teaching 12 Ji 
Other professions and occupations 

or several career choices 4 13 

х? = 5.71. 

р < 0/02. 


With respect to the quantity of occupations considered, de- 
pending on one's point of view, one might say that the high- 
creativity adolescents are more "diffuse" in occupational goals 


. than the high-IQ adolescents, or that they are more able and 


willing to deal with a greater range of career possibilities. As for 
the quality of occupations considered, again depending on one's 
point of view, one might say that the high-creativity adolescents 
are either more "eccentric" in their occupational goals or more 
able and willing to deal with career risks; that is, to take liberties 
with accepted standards of adult success. 

2. Data with respect to the second empirical question, the 
“success” orientation of the two groups, were obtained from the 
Outstanding Traits Test and provide further insight into the ca- 
reer aspirations of the high-IQ and high-creativity adolescents. 

The high-IQ's ranked the qualities in which they would like to 
be outstanding in the following order: (1) character, (2) emo- 
tional stability, (3) goal-directedness, (4) creativity, (5) wide 
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range of interests, (6) high marks, (7) IQ. and (8) sense of 
humor. The high creatives ranked the qualities in the following 
order: (1) emotional stability, (2) sense of humor, (3) char- 
acter, (4.5) wide range of interests, (4.5) goal-directedness, (6) 
creativity, (7) high marks, and (8) IQ. Most noteworthy here 
was the extraordinarily high ranking given by the high-creativity 
group to "sense of humor," a ranking which not only distin- 
guishes them from the high-IQ group (who ranked it last) but 
from all groups to which the test had been given. 

Тһе most relevant and striking differences, however, between 
the two groups in the context of the present inquiry are observed 
in the relationship of the qualities they want for themselves, the 
qualities they believe lead to adult success, and the qualities they 
believe teachers favor. For the high-IQ group, the rank-order 
correlation between the qualities they would like to have them- 
Selves and the qualities they believe make for success in adult 
life is 0.81; for the high-creativity group, it is 0.10. The rank- 
order correlation between the qualities the high-IQ group would 
like to have and the qualities they believe teachers favor is 0.67; 
for the high-creativity group, it is —0.25. (See table 5.) 


TABLE 5 


Rank Order Correlations among Subsections of the 
Outstanding Traits Test, for High-IQ and High-creative Students 


Students 


High-IQ — High-creative 
Components of correlation (Ҹ = 28) (М-20 


Personal traits believed “predictive of 
success” and “favored by teachers" 0.62 0.59 


Personal traits “preferred for oneself” 
and “believed predictive of adult 


Success" .81 40 
Personal traits **preferred for oneself” 
and “believed favored by teachers" 67 —.25 
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In effect, the high-IQ adolescent wants the qualities he believes 
make for adult success and qualities similar to those he believes 
teachers like; the high-creative adolescent favors personal quali- 
ties which have no relationship to those he believes make for 
adult success and are in some ways the reverse of those he be- 
lieves his teachers favor. The high-creativity adolescents are thus 
more “rebellious” or more “autonomous” than the high-IQ 
adolescents with respect to adult standards of success, depending 
on one's point of view, and the high-IQ adolescents are more 
"compliant" or more "realistic." In any case, it seems clear that 
there is a systematic relationship between types of cognitive func- 
tioning and types of carcer aspiration. The high-IQ and the high- 
creativity groups are characterized by differences in their career 
aspirations: differences all the more basic since the school 
achievement of the two groups as measured by standardized 
verbal and numerical subject-matter tests was the same. 


Discussion 

Several existing conceptual formulations may be cited to ac- 
count for the present data. Guilford's factors of convergent and 
divergent thinking are highly relevant. 


In tests of convergent thinking there is almost always one conclu- 
sion or answer that is regarded as unique, and thinking is to be 
channeled or controlled in the direction of that answer. . . . In di- 
vergent thinking, on the other hand, there is much searching about 
or going off in various directions. . . . Divergent thinking . . . is 
characterized as being less goal-bound. There is freedom to go off in 
different directions. . . . Rejecting the old solutions and striking out 
in some new direction is necessary, and the resourceful organism will 
probably succeed. 


In this sense, the high-IQ adolescents tend to favor “сопуег- 
gent" modes of problem-solving, and the high-creativity adoles- 
cents tend to favor "divergent" modes of problem-solving, 
whether in the cognitive function represented by performance on 
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the intelligence and creativity measures, or in the personal-social 
function represented by occupational and career choice. 

In the context of motivational theory, Maslow's formulations ~ 
of defense and growth are similarly relevant to the present issues. | 
He writes: 


Every human being has both sets of forces within him. One set 
Clings to safety and defensiveness out of fear, tending to regress, 


ardize what he already has, afraid of independence, freedom, separa- 
tion. The other set of forces impels him forward toward wholeness of 
self and uniqueness of self, toward full functioning of all his capaci- 
ties, toward confidence in the face of the external world at the same 
time that he can accept his deepest, real, unconscious Self . . . This 
basic dilemma or conflict between the defensive forces and the growth 


E 
hanging on to the past . . . afraid to take chances, afraid to jeop- 3 
\ 


trends I conceive to be existential, imbedded in the deepest nature of | 
the human being, now and forever into the future . . . 4 


Therefore we can consider the process of healthy growth to be a 
never-ending series of free choice situations, confronting each indi- 
vidual at every point throughout his life, in which he must choose | 
between the delights of safety and growth, dependence and inde- 
pendence . . . Safety has both anxieties and delights; growth has both 
anxieties and delights. 4 


In this context, the high-IQ adolescent may be seen as prefer- 1 


ring the anxieties and delights of safety, the high-creativity adoles- 


cent the anxieties and delights of growth. | 


It seems that the essence of the performance of the high-crea- 
tivity adolescents lay in their ability to produce new forms, to 
risk conjoining elements that are customarily thought of as inde- 
pendent and dissimilar, to "go off in new directions." The crea- 
tive adolescent seemed to possess the need to free himself from 
the usual, to diverge from the customary behavior; he seemed to 
enjoy the risk and uncertainty of the unknown. In contrast, the 
high-IQ adolescent seemed to possess to a high degree the ability | 
and the need to focus on the usual and to be “channeled and | 
controlled? in the direction of the right answers, the socially 


4 


*Maslow, А. Н. Defense and Growth, Merrill-Palmer Quarterly, | 
1 


3:37-38, No. 1, Fall 1956. Ж 
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accepted solution. He appeared to shy away from the risk and 
uncertainty of the unknown and to seek the safety and security 
of the already known. 

Moreover, the differences between the high-IQ's and the high- 
creatives are not restricted to their intellectual performance or to 
their occupational choice. The data concerning both cognitively- 
oriented and socially-oriented behavior are of a piece; the charac- 
teristics that describe one describe the other. The high-IQ’s 
tended to converge upon stereotyped meanings, to perceive per- 

“sonal success by conventional standards, to move toward the 
model provided by teachers, to seek out careers that conform to 
“what is expected of then. The high-creatives tended to diverge 
from stereotyped meanings, to move away from the model pro- 
vided by teachers, to seek out careers that do not conform to 
what is expected of them. It seems that the outstanding feature 
of all the data is the consistency of the cognitive (as defined by 
| performance on intellective tasks) and the personal-social (as 
_ defined by occupational choice and career aspiration) aspects of 
_ behavior. 
2 Turning to the educational implications of the research projects 
_ reported in these sections and, indeed, of the great bulk of re- 
search dealing with creativity, there seems to be little doubt as to 
which of these two personal orientations is more acceptable in 
‚(һе majority of our social institutions. Guilford, who clearly per- 
ceived this bias, says that education “has emphasized abilities in 
the areas of convergent thinking and evaluation, often at the 
expense of development in the area of divergent thinking. We 
have attempted to teach students how to arrive at ‘correct’ an- 
swers that our civilization has taught us are correct. This is con- 
vergent thinking. . . . Outside the arts we have generally dis- 
couraged the development of divergent thinking abilities, unin- 
tentionally but effectively." 

Failure to distinguish between convergent and divergent talent 
in our schools may have serious consequences for the future of 
our society. Both kinds of talent are sufficiently important to war- 
‘rant attention in educational theory and practice, and it is unwise 
to think of divergent fantasy as simply rebellious, rather than 
germinal, or unconventional career choice as invariably unreal- 
istic rather than courageous. 
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It is hoped that a multidimensional approach to the study of | 
giftedness along the lines attempted in these studies will iis 


variability of children. 


Partt V 


THE GROWTH AND DECLINE 
OF INTELLIGENCE 


11 


On the Growth of Intelligence 


NANCY BAYLEY 


One fact about intelligence was clearly evident to all the psy- 
chologists who investigated it, from Binet on: children develop 
it as they grow toward maturity. Whether or not mental growth 
ceases when physical growth is complete, whether or not adult 
intelligence declines with advancing age, whether or not there is 
some mathematical equation that characterizes the exact form 
growth curves take—these and many other questions have en- 
gaged the attention of research workers at various times. No 
definitive answers were possible until the results from longitudinal 
Studies became available. The University of California at Berkeley 
Was one of the first institutions to undertake longitudinal research 
оп intelligence. As reports based on follow-up studies of subjects 
who had been members of the experimental groups from birth 
Оп began to come in, at least tentative answers to many impor- 
tant questions about the growth of intelligence began to emerge. 
At the 25-year-point, Nancy Bayley summarized these findings. 
The Paper is an abridged version of “On the Growth of Intelli- 
gence,” American Psychologist, 1955, 10, 805-818. It is re- 
printed with the permission of the author and the American 
Psychological Association. 


One of the primary objectives of the Berkeley Growth Study 
(20) has been to study the processes of the development of in- 
telligence as measured by tests, During the 25 years since the 
Study was started, there has been continual change in psycholo- 
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. gists’ ideas and theories about intelligence. As a result, some of 
the changing theories and emphases are reflected in the series of 
reports that have been made on the growth of intelligence in 
these children. What is more, by their very nature these longi- 
tudinal studies have themselves contributed something to our 
knowledge of, and theories about, intellectual development and 
functioning. 

Ishould like here to review the data from the Berkeley Growth 
Study, together with some related material, as they bear on our 
knowledge of the growth of intelligence. 


| 
THE CONCEPT OF THE CONSTANT IO 


In early studies the intelligence quotient was found to be very 
practical: it served as an easily understood index of a child's 
relative ability, an index by which he could be compared with 
other children the same age or in the same grade at school. It 
was found that as a rule the IQ changed very little when a child 
was retested a week or a month or a year or two later. This gave 
people great confidence in the IQ's "constancy." Furthermore, 
there are advantages in being able to classify a child and have 
him remain as classified. But this very stability of scores over 
certain short periods of the life span led to the assumption that 
intelligence is a basic entity which changes only by accretions and 
decrements in quantity with childhood growth, adult stability, 
and senescent decline. Of course this is an oversimplified extreme 
position, though it seems to have been (and still often is) held 
by many people who have used “ТО Tests" in education and in 
practice. It is not, however, a position held for long by those who 
have been actively engaged in studying the nature of intelligence 
and its growth. 

Another result of the concept of the constant IQ has been its 
extrapolation, both forward and backward from the school age 
child, to include all ages, from birth to senescence. If the IQ is 
constant, then we should be able to classify a child in infancy 
according to his intellectual potential. We can plan his education, 
we can make better foster home placements, we can put the fee- 
bleminded into custodial care very young, and so on. 
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THE SELECTION OF INFANT TESTS 


Although the Binet-Simon tests and Kuhlman's American re- 
vision included items for the first year of life, little had been 
done on tests of infants before Gesell set up a normative study at 
Yale in the early 1920%. When the Berkeley Growth Study 
Started in 1928, we searched the literature for descriptions of 
infant behavior that would be suitable for evaluating intellectual 
development during the first year. The list tentatively compiled 
for our mental tests was heavily loaded with items from Gesell's 
norms, in their first formulations as published in 1925 (15). 
Many of these items were closely similar to those listed in other 
Sources, but Gesell had assembled an excellent set of materials 
9n which to test these behaviors. He was also- one of the few 
who had actually tested a fair sample of infants, thus furnishing 
good preliminary norms. We selected from both the test materials 
апа test items as first described by Gesell, adding items: from 
other sources, In many instances we found it necessary to work 
ОШ our own standard procedures and criteria of success or 
failure, 

These tentative schedules we applied to the 61 babies of the 
Berkeley Growth Study, each infant being brought in at monthly 
intervals, starting at approximately one month of age. Ratings 
and descriptions were made on each child's responses during the 
testing situation, The items finally included in the California 

irst Year Mental Scale were selected after analysis of their ade- 
quacy according to the usual criteria. These criteria include: 
their occurrence in all or most of the infants; the increasing per- 
centage of success on them with increasing age, for appropriate 
developmental stages; their internal consistency and correlation 
With the total behavioral criterion; and their apparent relevance 
as intellectual, or adaptive, functions. 


PREDICTION FROM SCORES IN INFANCY 


At the outset we had accepted the findings based on school age 
children, and assumed that IQ’s were constant at all ages. Con- 
Sequently we were amazed at the precocity of some of the babies 
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whose mothers seemed not very bright, and embarrassed at the 
poor records of other babies who, by the laws of inheritance, 
should have done better. But we soon found that our embarrass- 
ments and amazements were alleviated with time: a slow baby 
would forge ahead and redeem his inheritance, a precocious in- 
fant often seemed to rest on his laurels while the others caught up 
with him. We were not too surprised, therefore, when the statis- 
tical treatment of the test scores revealed that there was no rela- 
tion between relative performance in the first few months of life 
and scores earned at the end of the first year. 

When the report on the mental scores of the Berkeley Growth 
Study children during their first three years (7) was published, 
it was met by many with scepticism. However, in spite of their 
failure to conform with established theory, these Berkeley chil- 
dren continued to develop in their own individual ways. What is 
more, we have corroborative evidence from the records of the 
children in the Guidance Study, as reported by Honzik (18), 
and more recently by Honzik, Macfarlane, and Allen (19). 
Furthermore, these irregularities in mental growth were found 
to occur in other than Berkeley children. Wherever careful sta- 
tistics have been applied to comparisons of repeated test scores 
on infants and very young children the correlations between tests 
separated by a year or two are low. It is now well established 
that we cannot predict later intelligence from the scores on tests 
made in infancy (1, 16). Scores may be altered by such condi- 
tions as emotional climate, cultural milieu, and environmental 
deprivation, on the one hand, and by developmental changes in 
the nature and composition of the behaviors tested, on the other. 
These latter factors are the primary concern in this paper. 

As the Berkeley Growth Study children grew older we con- 
tinued’ to record their progress by successive tests at frequent 
intervals. We have from time to time reported the results of these 
tests, along with efforts to find relationships between mental 
growth and other factors (6). When the children were 8 years 
old a study of the individual growth records showed that only 
a fifth of the group had maintained any stability in their relative 
status over the eight-year span (8). Even these few had unstable 
Standard Scores during the first two years. 

This lack of stability in infant test scores has resulted in various 
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efforts to supplement and to correct the infant tests to make them 
more predictive. It has been suggested that the scales are not 
composed of the right kind of test items. However, efforts to de-- 
Vise other, more adequate scales, invariably run into the hard 
fact that infants exhibit a very limited range of behaviors that 
сап be observed and recorded. The various scales of infant in- 
tellipence have a remarkable similarity of content. At first there 
is little to note beyond evidences of sensory functioning in re- 
acting to appropriate stimuli. One can observe that the one- 
month-old looks momentarily at a dangling ring, or at a rattle 
Or other small object. Or one can vary the source of the sharp 
Sound that will make him start or blink. A little later the responses 
are evidenced in motor coordinations: the six-month-old may 
pick ир a one-inch cube or a teaspoon placed in easy reach. 
There are some early evidences of adaptation to the presented 
stimuli, of memory from a past experience; the seven-month-old, 
for example, looks “aware” that a fallen toy is no longer there, 
and when a little older he may turn to look for it on the floor. 
One can note the progression of vocalizations as they become 
more complex and then as they are used meaningfully. There is 
a developing ability to discriminate differences, to be aware of 
Dew situations, to recognize differences between members of the 
family and strangers, and so on. 

Тһе question is: Which, if any, among these is the forerunner 
of later intellectual functions? Which, if any, will predict the in- 
dividual differences found in school age children? 

One method of testing and selecting predictive items has been 
to use a later (or “terminal”) measure of intelligence as the 
criterion. Scores earned by infants or very young children on 
Individual test items have been correlated with their later IQ's. 
Those items showing the highest r's with the criterion have in 
Some instances been combined into scales. Theoretically, if other 
Items of similar nature are then devised and added, such a scale 
Сап be expanded into an adequate predictive test. This method 
has been tried on infant scales by L. D. Anderson (2) and by 

elson and Richards (25). They compared successes on items 
under one year with retest criteria at ages 2 to 5 years. Maurer 
(22) compared scores on items in tests given children at 3 to 5 
Years with their scores at 15 years as a criterion. More recently 
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Hastings compared preschool test items with 14- to 18-year scores 
from our studies at the Institute of Child Welfare (17). In all of 
these studies some items have proved to be better predictors than 
others. Hastings selected items from the Guidance Study records 
and validated them on the Berkeley Growth Study (19 boys and 
18 girls). His predictive items were good for the boys, but not for 
the girls in the validating sample. These boys had a wide range 
of ability, and thus an unusually large SD of scores. Their 2-year 
performance on a scale made up of good predictors correlated 

_ -67 with scores at 16-17 years. The same comparisons for the 
girls gave an r of .34. In general the predictions were better at 
the later preschool ages. 

We have tried to find predictive items from the First Year 
Scale on the Berkeley Growth Study children. Several years ago, 
using the six children at each extreme of intelligence as measured 
at the 14 to 16 year tests, we went through the First Year Scale 
item by item, noting the age at which each of these 12 children 
first passed each item. We were able to select 31 items in which 
the six high-scoring teenagers had, as infants, been two months 
or more advanced over the six low-scorers. These items were an 
odd assortment, and there was no evident reason for their su- 
periority over other items. Most of the items occur in the second 
half year, where there is a fair amount of range in scores. In the 
first few months very few items had a range of more than two 
months in age at first passing. 

Recently we computed scores for the total Berkeley Growth 
Study sample on this 31-item scale for three ages: months 6, 9, 
and 12. The r’s of these new point scores with the mean of the 
intelligence sigma scores at ages 16, 17 and 18 years (for 45 
cases) are .09 at six months, .32 at 9 months, and .30 at 12 
months. We were unable to get significant correlations even 
though our sample was composed in large part of the cases on 
whom the items were selected, including all of the extreme cases 
that would determine a relationship. 

So far, none of these efforts has been successful in devising an 
intelligence scale applicable to children under two years that will 
predict their later performance. The moderate successes of 
Maurer and of Hastings have been on items at the two-year level 
of difficulty or older. Even here the r’s are not high enough for 
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accurate prediction on individual children. As far as I know, no - 


one has used these items to set up and standardize an expanded 
scale. There does seem to be some coherence in the types of 
function tested by the predictive items. It is interesting to note, 
too, that those items which are good predictors are often not the 
items that best characterize a child's current stage of develop- 
ment. It has even been suggested that a scale should combine 
both types of items and then be scored in two ways—one score 
for evaluating present status and one for predicting future de- 
velopment. 

These findings give little hope of ever being able to measure a 
Stable and predictable intellectual factor in the very young. I am 
inclined to think that the major reason for this failure rests in 
the nature of intelligence itself. I see no reason why we should 
continue to think of intelligence as an integrated (or simple) 
entity or capacity which grows throughout childhood by steady 
accretions. 


THE CHANGING ORGANIZATION 
OF INTELLECTUAL PROCESSES 


Intelligence appears to me, rather, to be a dynamic succession 
Of developing functions, with the more advanced and complex 
functions in the hierarchy depending on the prior maturing of 
earlier simpler ones (given, of course, normal conditions of care). 
The neonate who is precocious in the developing of the simpler 
abilities, ‘such as auditory acuity or pupillary reflexes, has an ad- 
Vantage in the slightly more complex behaviors, such as (say) 
turning toward a sound, or fixating an object held before his eyes. 
But these more complex acts also involve other functions, such as 
neuro-muscular coordinations, in which he may not be pre- 
Cocious. The bright one-month-old may be sufficiently slow in 
developing these later more complex functions so as to lose some 
Or all of his earlier advantage. This is the kind of thing that does 
Seem to happen. Scores on tests given a month apart are highly 
Correlated, but the longer the time interval between these baby 
tests the lower the intertest correlation. 1 y 

If intelligence is a complex of separately timed, developing 
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functions, then to understand its nature we must try to analyze 
it into its component parts. One approach to this process has 
been by factor analysis. Of the two main theories resulting from 
factor analysis, our data would seem to fit better into some varia- 
tion of a multiple-factor than a two-factor theory. Or perhaps 
they fit better a theory that is intermediate, somewhere between 
the two. 

The program of the Berkeley Growth Study has not been car- 
ried on in such a way as to make factor analysis on this material 
practicable. For one thing, the number of cases is too small for 
the usual factorial procedures. Also, for such a purpose one 
might have chosen a different or a more extensive series of tests. 
(As it is, the children have tolerated an amazingly large amount 
of testing and measuring!) 

Nevertheless, some of our findings should point the way to new 
areas where factorial or other kinds of analysis would be fruitful. 
I should like to know, for example, where to look for g in the 
infant scales. One might expect g to be that factor on which pre- 
diction could be based. If g is not present at first, then when and 
how does it appear? Or does g itself change as its grows more 
complex? How do factor loadings distribute themselves in infant 
scales? Does a heavily-loaded first factor show a characteristic 
developmental process of change? 

Richards and Nelson (27), using the Gesell items, at 6, 12; 
and 18 months, obtained two factors which they called "alert- 
ness" and “motor ability." They found age changes in com- 
munality of the tests that were in part due to restrictions in the 
type of items included in the scales at the older ages. This very 
fact reflects the relatively undifferentiated nature of behavior in 
the very young. It may be a mistake to try to call any infant be- 
havior before 6 months more characteristically “mental” than, 
for example, motor. In spite of progressive selection of behaviors 
observed in intelligence tests, the evidence of a motor factor 
persists in the early ages of the Stanford-Binet, according to 
McNemar’s factor analysis (23). These studies only scratch the 
surface of what needs to be done to gain real understanding of 
the nature of early mental processes. 

If the word “intelligence” is best used as a broad general term 
that we apply to a great variety of mental functions, then we 
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will want to investigate the nature of these functions, their inter- 
relationships and the changes that take place in mental organiza- 
tion with growth. We should expect a given *factor" of intelli- 
gence to be more important at one stage of development than at 
another. As Garrett (14), has shown, іп a summary of factor 
analyses, there is evidence of increasing independence of mental | 
factors as children grow older. Does this trend continue indefi- 
nitely? Or do some of these factors become functionally reinte- 
grated as they mature? The studies of Thurstone and others can 
be most valuable in yielding information on this point. Let us 
hope they will be continued over the entire life span, with careful 
attention to the problem of selecting items to test all relevant 
mental functions at all ages. 

Тһе very fact that the scores of mental growth in individual 
children tend to exhibit gradual shifts in relative status supports 
the theory that a changing organization of factors is in process. 
Something akin to g, or a high first-factor loading, must appear 
soon after the second or third year. The correlations of tests at 
these ages become positive with the later test scores. After 5 or 6 
years children can be reliably classified into broad categories of 
normal, defective, and bright.* 


PROBLEMS ENCOUNTERED IN CONSTRUCTING 
CURVES OF GROWTH IN INTELLIGENCE 


_ The use of intelligence quotients, or standard scores, in study- 
Ing growth changes in children is helpful in showing a child's 
—— 


Hofstaetter has made а factor analy- 
ES Using the 18-year consistency correlations of my data (3). He 
Obtained three distinct factors: the first is predominant for the first 
two years, the second between 2 and 4 years, and the third accounts 
or almost the entire variance after 4 years. He names them: I, Sen- 
y Motor Alertness, II, Persistence, and III, Manipulation of Sym- 
Ols. This latter is most likely the general intellectual factor that 
Most intelligence tests are designed to measure. These are, of course, 
Blobal, or total-test characterizations, but they illustrate the complete 
Teak between the kinds of function measured in infants and in school- 
зге children, (Hofstaetter, P. R., The changing composition of "in- 
neagenee”: a study of r-technique. J. genet. Psychol., 1954, 85, 159- 
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shifts in status relative to the norms. But a child's progress, in 
relation to his own past, is better represented if we can use scores 
that measure increments or amounts of intelligence. Here we run 
into the problem of comparable units. Lacking absolute units for 
measuring intelligence, we must settle for some measure of 
Breater or lesser difficulty, or degree of complexity of intellectual 
functioning. The first, and perhaps still most generally used unit 
of intelligence is mental age. Such a unit tends to force the same 
value on a mental age increment of (say) a month, whether it 
Occurs at 6 months of age, at 6 years or 16 years. Thurstone 
(30), Thorndike (28), and others have tried by various devices 
to set up units that approximate equality of difficulty at all levels 
of complexity. This is done usually by comparing the overlapping 
distributions of scores earned by children of successively older 
ages. Such units would vary with the test and with the normative 
sample. In any event, they remain only approximations. When 
we accept and label them as such, however, they become useful 
in comparing age changes in ability. 
Thurstone applied his method to the Berkeley Growth Study 
. Scores on the California First Year and Preschool Scales for the 
first two years (7). We later extended the scaling through five 
years, and obtained the curve shown in Figure 1. This curve is 
positively accelerated for a few months, then settles into a con- 
sistent rapid growth for almost a year, after which there is a 
gradual slowing down in the rate, though growth continues to be 
fairly rapid. The curve makes sense in the light of ordinary ob- 
servations of children’s early development. It seems to be a useful 
approximation, even though one cannot claim absolute equiva- 
lence of difficulty of the units at different levels. 


Problems of Equating Different Scales 


When the children grew older, and an extension of the scale 
was in order, we ran into another problem. We had to find new 
tests, adapted to the children’s increased mental capacities. At 
the beginning of the study there had been no well-standardized 
infant and preschool scales, and we had found it necessary to 
develop our own. However, good standard tests were available 
for school age children. The 1916 revision of the Stanford-Binet 


ON THE GROWTH ОЕ INTELLIGENCE 151 


BERKELEY GROWTH STUDY 
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Fig. 1. Curve of intelligence, one month to 60 months, Berkeley 
Growth Study, according to Thurstone's method of Absolute Scaling. 


was given at 6 years. Since that time we have consistently used 
Standardized tests of intelligence, including the 1916, and both \ 
forms of the 1937 Stanford Revision of the Binet, the Terman- 
McNemar Group test, and the Wechsler-Bellevue Adult Intelli- 4 
Bence Scale, Form I. But shifts in scales, with their different | 
Norms and units of increment, have complicated the problem of 
Setting up a single continuous scale of mental growth units. This- i 
Problem has not been solved, but I have approached it tenta- | 
tively in several ways. | 
А few years ago, in presenting some data on mental growth for 
the first 1g years (3), I transposed the early scores into mental 
age equivalents, These scores, together with the Stanford-Binet f 
menta] ages, give us age units from birth to 17 years, The mean / 
Mental age curve of the Berkeley Growth Study children is shown. 
in Figure 2. At 17 years, the latest available Stanford-Binet М.А. | 
Score for this group, the scores were continuing to increase. How- 3 
еуег, the rate of growth as expressed in M.A. units has diminished | 1 
at the later ages. The standard deviations, shown in the lower 
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Fig. 2. Curves of means апа SD's of mental ages, 1 month 10 17 


years, Berkeley Growth Study. From Bayley (3, р- 169). 
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part of Figure 2, do not increase at a constant rate but are rela- 
tively large around 10 to 12 years. Similar trends in variability 
may be found in other samples, and for other tests. This, I have 
argued (3), reflects a true state of increased variability in intelli- 
gence during early adolescence, 
; The curve of the mean mental ages is in many ways similar, 
for the same age intervals, to curves constructed by other investi- 
gators, using other units of mental growth. The general similarity 
holds whether the scores are based on longitudinal or cross-sec- 
À tional samples. 
Accordingly, I felt justified in using this longitudinal M.A. 
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curve in conjunction with the Jones and Conrad (21) curve 
based on cross-sectional data and standard score units, to con- | 
struct a theoretical curve of the probable course of intelligence 
from birth to 60 years (5). . . . It is similar to curves offered 
by Miles (24), Wechsler (37), and others. However, more recent 
data on the Berkeley Growth Study, together with data from 
other studies, raise questions concerning the representativeness of. 
this curve. 4 
The data оп the Berkeley Growth Study do not stop at 17 
years. The Wechsler-Bellevue Adult intelligence scale was given. { 
at 16, 18, and 21 years, and we are currently repeating the test 
at 25 years. A study of the growth of intelligence between 16 and | 
21 years, as measured by these tests, is now in press (4). The 
Scores were found to increase through 21 years. This was true | 
for each category, at least to 18 years, and for the Efficiency | 
Quotients based on the total test. It was even true of the IQ's. 


These trends are shown clearly in the curves of the means. . . « 


CURVES OF MEAN WECHSLER-BELLEVUE SCORES 
33 CASES TESTED AT 3 AGES К 
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Performance EQ 
Verbal EQ 
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Fig. 3. Age curves of Wechsler-Bellevue 10% and EQ's, Berkeley. 


Growth Study. From Bayley (4). 
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The total scores in Figure 3 are expressed as quotients: total IQ, 
and EQ, and Verbal and Performance EQ. (The EQ expresses 
the deviation of the weighted score from the norm for 20-24- 
year-olds [37].) The gains occurred at all levels of ability within 
the group. All but one of the 33 subjects made some gain in 
total weighted score over the five-year period. 

These data are in agreement with other investigators’ findings 
on retests of the same individuals. Freeman and Flory (13), and 
Thorndike (29) have found for different samples, and for dif- 
ferent tests, that intelligence scores continue to increase at least 
to 21 years. Dearborn and Rothney (72) have fitted the Harvard 
Growth Study data to a curve that, by extrapolation, indicates 
mental growth would continue to 30 years. 

The general appearance of the Wechsler-Bellevue weighted 
score curve for the Berkeley Growth Study gives the impression 
that it could very well fit on as a continuation of the 17-year 
mental age curve. But to put the two curves into a single con- 
tinuum would require transposing the scores into comparable 
units, This I have attempted to do, in the hope that it will give at 
least a rough approximation of the direction of mental growth. 


The Construction of the 16D Scale 


The Berkeley Growth Study tests were scheduled so that alter- 
nating forms of the Stanford-Binet were given annually through 
12 years and again at 14 and 17 years. The Terman-McNemar 
Group test was given individually, Form C at 13 years and Form 
D at 15. The Wechsler-Bellevue was thus dovetailed in, having 
been given at years 16, 18, and 21. If we assume that the 16-year 
Wechsler-Bellevue scores earned by these subjects are equivalent 
in difficulty to a mental age at the 16-year point on their Stan- 
ford-Binet mental age curve, we can start at 16 years as a basis 
for equating the two sets of scores. At the adjacent ages the 
Stanford-Binet M.A.s have standard deviations averaging 34 
points, while the Wechsler-Bellevue SD's were about 20 and the 
Terman-McNemar SD's about 19 points. 

With these data, starting with the Means and SD's of the 16- 
year scores, we have constructed a method of transposing the 
scores from all tests into what may be called 16D Scores. That is, 
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each child's scores at all ages are expressed in terms of the 16- | 


year standard deviations from the mean scores at 16 years. | 


To do this, a table of equivalents was made by extrapolating 
the Terman-McNemar scores and interpolating the Stanford- 
Binet scores, to obtain a 16-year mean, or assumed mean, score 
for this sample on all three tests. To get comparable standard de- 
viations for the three tests, the Stanford-Binet M.A. units were 
reduced by the fraction 20/34, and the Terman-McNemar units | 
were increased by the fraction 20/19. Then, taking an arbitrary | 
Score of 140 to represent the 16-year mean, the three scales were 
related to this new 16D scale, point for point so that the 16-year 
mean would equal 140, while plus and minus one SD at 16 years 
would equal 160 and 120 respectively. This scale can be ex- 
tended in either direction. All scores for all ages are expressed as 
deviations from the 16-year level. 

The resulting curve, based on the means an 


d SD's of the 16D 


Scores, is shown in Figure 4. Whether or not it is a legitimate | 


construct, it looks reasonable, and not too far from the probable 
trends of growth in intelligence. It would have been better to- 
construct the curve оп a more nearly average sample, but at least қ 
ме may be justified in using the 16D scores to apply to ће mem- - 


bers of the Berkeley Growth Study, as one way of expressing ү 


ye INTELLIGENCE BY AGE : 16 D SCORES 
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Fig. 4. Curves of means and SD' 
to 21 years, Berkeley Growth Study. 
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their progress toward, and development beyond, their status at 
16 years. 

Sixteen years has no particular significance as a point of refer- 
ence: it was chosen because it was the only age at which the 
three scales we had used could be approximately equated for this 
sample. It would have been more satisfying if we could have 

- started at a terminal point, say, conception, or birth, or the age 
at which scores stop increasing. However, 16 years is one age 
that has been considered a terminal point, or at least the age 

_ beyond which the ratio IQ cannot be used without modification. 

_ The score of 140 at 16 years was chosen because, from this figure 

- when the curve is extrapolated downward from the mean score 

| L'obtained at month one, the curve approximates zero at concep- 
| tion. 


1 


_ THE VALUES AND LIMITATIONS OF STANDARD 
. SCORES AND INCREMENT SCORES 


Standard Scores: Individual Curves 


Let us consider some individual curves of intelligence scores 
earned by these subjects. In the past we have usually presented | 
individual records in the form of Standard Scores or Sigma Scores 
for this group. Such scores are very useful for observing a child’s 
. changes in performance relative to others his age. We can see 
_ his ups and downs, and try to relate them to variable factors, en- 

vironmental or other, that might have caused the changes. 

__ We have found that the Standard Scores gave a truer picture of a 
_ child's relative status at successive ages, because there were ape 
© changes in variability of the IQ's. That is, the variability of the 
М.А. did not, as had been assumed, increase with age in such a 


“уау as to maintain a constant 50 of 15 or 16 points in the 
_MA/CA ratio. . . . 

T 

! 


Intercorrelations 


In our comparisons with such things as emotional and environ- 


y 
7 
- mental factors that could affect test scores, we have found the 


1 


Шан 
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Y 
Standard Scores to be of value. For example, we have correlated 
the children's Standard Scores on intelligence at successive ages | 
with the amount of schooling achieved by their parents. The age- - 
changes in correlation (as expressed in Z scores) for this com- 
parison are shown in Figure 5. The infants’ scores at first are , 


Correlation Between Midparent Education 
апа Children's Intelligence Scores 


8 10 12. 14 
Age of Children 


children's intelligence scores and parents’ 


Fig. 5. Correlations between 
education. From Bayley (9, p. 7). 


, 
independent of parental status or negatively correlated, but aft 
18 months the r's become positive, and by 5 years are about 5 
Individual curves . . . illustrate differences in the ages at whic 
children's scores approach the level of their parents’ educatio 
Status as expressed in standard scores (9). E. 
Standard scores have been used to correlate mental ability with 
emotional factors. For example the r's between children's stand- 
ага scores and the amount of time they spent crying during the 
Period of observation and measurement were at the zero level 
during the first year. Then, too, the repeated standard scores o 
tained for one child on intelligence, can be correlated with r 


mm 
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peated scores on other variables, using the repeated observations 
on a single child as a population. For example, I obtained an 
“Optimal” score for each testing by combining 8 ratings that 
were indicative of the babies' responsiveness, or attitudes that 
might affect their performance on the tests (6). The r's between 
these Optimal scores and intelligence at any one age were close 
to .30. Twenty of the children had Optimal scores available for 
from 12 to 15 test ages each, for the age-span between 6 months 
and 3 years. Using the rank difference method of correlation, 
rho's were computed for each child between his mental standard 
scores and his corresponding Optimal scores. These rho's ranged 
from plus .77 to minus .33. For similarly-constructed "Attitude" 
scores, based on ratings made between 2 and 7 years of'age, the 
individual children's rho's ranged from plus .76 to minus .46. 
The wide range of correlations obtained corroborates the im- 
- pression that observable emotional factors and attitudes (seen 
also in age curves of the different variables), rated at the time 
of the test, are to some extent related to the test scores, and evi- 
dently serve to help or to hinder the child's intellectual function- 
. ing. But other factors are also operative in determining a child's 
| shifts in scores. These other factors may, in some cases, be so 
- strong as to override the effects of emotional attitudes, resulting 
. in negative correlations between mental performance and the 
_ child's observed responsiveness to the testing situation. 

It becomes evident that the intellectual growth of any given 
child is a resultant of varied and complex factors, These will in- 
clude his inherent capacities for growth, both in amount and in 
rate of progress. They will include the emotional climate in 
which he grows: whether he is encouraged or discouraged, 
whether his drive (or ego-involvement) is strong in intellectual 
thought processes, or is directed toward other aspects of his Ше- 
field. And they will include the material environment in which 
he grows: the opportunities for experience and for learning, and 

- the extent to which these opportunities are continuously geared 
to his capacity to respond and to make use of them. Evidently 
all of these things are influential, in varying amounts for different 
individuals and for different stages in their growth. Many of 

- these factors can be studied by observing concomitant variations 

_ їп Standard Scores. 
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INDIVIDUAL DIFFERENCES ІМ GROWTH RATES 4 


But Standard Scores, and other measures of relative status, | 
have limited usefulness in the study of individual differences in 
rates of growth. Relative scores tend to make us forget that in- | 
tellectual growth is a dynamic ongoing process, in which both | 
averages and standard deviations in scores are related to the age : 
ОЁ the subjects. It is worthwhile, therefore, to try to present in- 
dividual curves of growth in units that will emphasize a child's _ 
Change in relation to himself. Growth curves will enable us to | 
Observe a child's periods of fast and slow progress, his spurts and 
plateaus, and even regressions, in relation to his own past and 
future. 

Such a growth curve has been shown in Figure 1, based on | 
absolute scale units, for the first five years. . - - Study of the | 
complete sample of individual curves reveals a great variety. 
There may be plateaus, periods of no growth, and occasionally - 
actual decrements. There may be rapid forging ahead. Each | 
child appears to develop at a rate that is unique for him. sn 

By using the 16D scale we are now able to construct individual | 
Curves that extend for the entire period of the study. Figure 6 | 
Bives 16D curves for 5 boys. They cover the age span from one 
month to twenty-five years. Compared to the later years, the first 
five years seem very reduced in scope and the curves appear very 
homogeneous. If they are expanded to the same scale as the | 
Thurstone curves, we find that for any given child both curves | 
show the same periods of acceleration and retardation. The slopes. 
Of the Thurstone and the 16D curves аге somewhat different, but А 
the patterns of accelerations and retardations are generally simi- 


lar in nature. 
Although each child has his 
the patterns are not completel 


fancy there is a strong underlying consiste Sc 
Children forge ahead and maintain relatively advanced positions 


after 5 or 6 years of age. Others grow slowly and lag behind. 
There is some shifting of position, but the changes are gradual 
Over rather long intervals of time. Within such intervals we can. 
€Xpect to obtain fairly constant Standard Scores (10 S): 

It is notable that these five boys have all been tested at 25 _ 


own individual pattern of progress, í 
y random. After the period of in- 
sistency or constancy. Some | 


П 
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INDIVIDUAL CURVES OF 16 D SCORES (INTELLIGENCE) 


16 D Store 


A о 'S д 6 EJ 2 15 
1 Age in Years. 

Fig. 6. Individual curves of intelligence (16 D units) for 5 boys, one 
t ў month to 25 years. Berkeley Growth Study. 


в г 25 


years, and all five have continued to improve in their Wechsler- 
Bellevue scores. The continued growth occurs at all levels of 
ability. Case 13M, the slowest boy, has had increments in his 
Wechsler-Bellevue 10/8 from 63 at 16 years to 78 at 25 years. 
This boy spent much of his childhood (ages 10 to 23 years) in an 
| institution for the mentally retarded. When tested at 21 years he 
Һай never learned to read more than a few words. Now at 25 he 
_ reads, slowly to be sure, but he read aloud without error the 
_ Wechsler-Bellevue arithmetic problems. .. . 

|... Some of the dips in the individual curves are due to changes 
in the tests. For example, those who have trouble in reading 
_ make relatively low scores on the Terman-McNemar Group 


ч Slight irregularities may reflect temporary conditions of moti- 
_ yation, health, or emotional factors. The more constant shifts re- 
"quire other explanations. Though they may result from prolonged 

emotional or environmental influences, they may also express in- 
herent tendencies to develop at given rates. І Suspect that each 


ы. 


deviation. The subjects ranged in age fro 
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child is a law unto himself: in some instances certain factors are ! 
more important, while in others different factors play the de- ; 


termining role. І 


TEMPORAL CHANGES IN ADULT | 
INTELLIGENCE 


The few 25-year scores so far available indicate that the in- | 
tellectual processes measured by these tests have not yet reached | 
à ceiling. Fourteen out of fifteen subjects tested show continued | 
increments. If these are typical cases, what, then, may we ven- 
ture to predict for the years ahead? The alternative explanation 
Of practice effects from repeating the same test might be offered. 1 


But the intervals between repeats on the Wechsler-Bellevue are | 
2, 3, and 4 years. These are rather long times to remember much | 
about the specific items. Nevertheless, there is probably some - 
Tesidual memory for, or vague familiarity with, the task and the 
type of solution found at the previous testings. At present we 
Must assume that these factors account for part of the increment, | 
On the other hand, we have some recent evidence that some 
intellectual functions do continue to improve with age in adults. 
When the same individuals are retested after long intervals on 
the same test or on an alternate form of a test, the scores on the 
Tetests are significantly higher. These retests were carried out on. 
Superior adults, and their patterns of mental change may be dif- 
ferent from those of less able persons. р 
In a recent study of the adult intelligence of the subjects of the. 
Terman Study of Gifted Children, Bayley and Oden (10) found 
that scores on the difficult Concept Mastery test increased on a 
Second testing. For a population of over a Шола оаа 
of Gifted Study subjects and their spouses, comparisons wet 
made between two tests that had been taken about 12 years apart. 


( 
The increase in scores on the retest averaged about half a standard | 
m about 20 to about 50. 


-year age intervals, the 


Years. When they were grouped into 5 
test-retest scores of all age groups increased. . . . 4 
Similar results have been reported by Owens (26) who re- 
i 

Hi 
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peated the Army Alpha test at 50 years on 127 men who had 
first taken the test as 19-year-old freshmen at Iowa State College. 
Their scores improved by .55 SD’s over the 31-year interval. One 
can hardly claim practice effects after a lapse of 31 years. Even 
the 12-year interval of the Terman study is rather long for any 
such claim: also the Gifted Study subjects were retested on an 
alternate form, thus ‘ruling out specific memories of items. 

_ Furthermore, there were control groups consisting of those who 
"were tested only once, at either the 1940 or the 1951 testing. 
Тһе differences in mean scores of these groups at the two test- 
ings are the same as for the twice-tested groups. 


A SUGGESTED FIFTY-YEAR CURVE 
OF INTELLIGENCE 


f I have experimented with using the data from these two studies 
М of adults to extend the 16D growth curve to 50 years. The sub- 
Ў jects of the Berkeley Growth Study аге, on the average, а some- 
- what superior group. Their 16-year Wechsler-Bellevue mean IQ 
is 117, and their 17-year Stanford-Binet mean IQ is 129. A small 
group of 25-уеаг-о145 who have taken the Concept Mastery 
| earned scores close to the average for the spouses of the Terman: 


subjects at that age. We may assume, then, that this sample is 

rather similar to the Iowa State Freshmen and to the spouses of 
the Gifted Study subjects, in its general level of test perform- 
ance. It has, therefore, seemed reasonable to join the data from 
the Berkeley Growth Study directly to the scores of either of the 
other studies, in extending the curve, as in Figure 7. 

This joining of the curves has been done for the Iowa study 
simply by placing the 19-year initial point at 19 years on the 16D 
curve and the 50-year point at the equivalent on the 16D scale 
of an increase of .55 standard deviations. 

For the Gifted Study spouses the process was a little more 
complicated, but it has yielded a series of intermediate points, 
giving some indication of the probable shape of the curve. To 
obtain these points, I plotted a series of SD increment curves, 
о the successively older ages at points on the curves of the 


placing 2 
younger groups in such a way as to take into account the growth 
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& COMPOSITE AGE CURVE OF INTELLIGENCE 
Concept Mastery — a rune, CENE 
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'Агту Alpha (Owens) 
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16 D Score 
- о 
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Age іп Years 
DE 7. A propased age curve of intelligence, birth to fifty years. Ў 
ased on data from Berkeley Growth Study, the Terman Gifted Study 
and Owens Iowa Study. 


e.* From these series of 


already attained at any new starting ag 
and equivalent 


Overlapping curves, a smoothed curve was drawn, 
16D scores were read off at 5-year intervals. 

The resulting two-pronged curve for the 50-year span shows a 
More modest increment for the Alpha scores of the Iowa теп. 
The Concept Mastery scores of Gifted Study spouses gain a full 
Standard deviation, or about twice as much, Of course, since 
both of these curves are only approximations, neither may be 
More correct than the other. The differences are probably due, at 
least in part, to differences in the testing instrument, The Con- 
Sept Mastery scale for one thing, has far more top than the 
Alpha, and allows for much greater expansion upward. 

That is, the youngest group was tested at 20 years and again at 


32, with a gain of .4 SD. The 25-year initial score of the next older 


оар was Шеп plotted at the 25-year point on the first curve (or at 
:19 SD) and their gain at 37 years was plotted as 33 SD above this 
Point (or at .52 SD), and so on for successively older groups. 
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We have here evidence that tested intelligence, as measured 
by verbal concepts and abstractions, continues to grow when 
populations composed primarily of superior adults are retested. 
Intelligence may also continue to increase in the less bright. 
Certainly, the less favored members of the Berkeley Growth 
Study are still improving their scores at 25 years. What is more, 
in several other studies there is evidence that this phenomenon 
is not confined to individuals tested at the University of Cali- 
fornia Institute of Child Welfare. Freeman and Flory (13), for 
example, divided the children in their study on the basis of 
Scores at 12, 13, and 14, into low and high scores. At the later 
ages, 16 and 17 years, the low-scoring group was continuing to 
improve at a faster rate than the high-scoring group. A recent 
study by Charles (77) reports retest IQ's for 20 adults who had 
been diagnosed in childhood as feeble-minded. Their mean child- 
hood Stanford-Binet, 1916, IQ was 58 and their mean adult 
Wechsler-Bellevue IQ was 81. Charles accounts for this differ- 
ence in two ways: errors of diagnosis in childhood, and evidence 
from other studies that people who score low on the Binet test 
tend to make higher scores on the Wechsler. Similar explana- 
tions have been offered for similar findings in other studies. But 
а mean increase of 23 IQ points amounts to 1.5 SD's of either 
of the tests used. This is a rather large shift to be attributed to 
test differences in restriction of scores, to regression phenomena, 
or to errors in the original test. АП 20 individuals improved on 
the retest. It seems to me quite possible that these people did 
continue to improve in their mental ability, 

There are many gaps in our knowledge of the nature of in- 
telligence, and many questions remain unanswered concerning 
age changes in mental organization. In the curve presented in 
Figure 7, there remains an unanswered discrepancy between the 
adult portion and data for these ages presented by earlier in- 
vestigators, who have found decrements in scores with increas- 
ing age after about 21 years. In the earlier studies some types 
of functions held up better than others. Owens found that those 
abilities that had held up best on the cross-sectional samples 
were the same ones that increased the most on his retests. The 
real difference between the conflicting findings seems to lie in 


cha 
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the longitudinal as opposed to the cross-sectional method of ob- 
taining scores for successive ages. In the former we have a con- 
stant sample whose life experiences, age for age, will have been 
Similar in pervasive environmental conditions, such as wars, 
technological advances, and methods of education. 

If, after taking adequate account of practice effects, the in- 
creases still remain, then the next question is to inquire into the 
nature of the tests, and the extent to which they measure intel- 
lectual abilities, Do such tests as the Army Alpha and the 
Wechsler-Bellevue, for example, measure intelligence in adults? 
Or do they tend to reflect continued experience in an increasingly 
enriched environment? Do the younger generations have more 
opportunity to develop their intellectual capacities than did their 
parents, or even their older brothers and sisters? Or are we just - 
measuring the effects of increasingly widespread informal edu- 
Cation made, possible by radio, television, and other modern 
means of communication? 

If, regardless of the cause of the improved scores, they reflect 
actual degrees of competence outside of the testing situation, 
then these scores continue to have practical value. Another prac- - { 
tical question is: What norms should be used in measuring de- | 
terioration resulting from brain injury, or from senescence? 
Perhaps it will be necessary to compare a present 50-year-old 
man’s score with norms for, say, those who are 50 in 1954, 
Tather than with 50-year norms for other decades. ` 

What normal age changes should we expect in mental organi- 
Zation? The curve presented here is a composite. The forms of 
Browth curves vary according to the functions measured. We. 
Should expect differences in the steepness of increment and | 
decrement in growth curves of the different functions, and dif- 
ferences in the ages at highest efficiency. These differences have Í 
been found consistently in cross-sectional studies. The question 
Taised here is whether more adequate studies, of the same in- | 
dividuals through time, will not show that the age of highest | 
intellectual capacity is later than we thought, and that the decre- i 
Ments in abilities are, correspondingly, deferred. ў і 

This curve is offered as an alternative to previously published | 
ABe-curves of intelligence. I should like to see it tested with | 
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further research that would refine, modify, and extend it into a 
more complete and accurate representation of intellectual changes 
over the entire life span. 
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Part VI 


THE NATURE-NURTURE 
CONTROVERSY 


12 
Schooling Makes a Difference 


IRVING LoRGE 


The issue around which the most acrimonious debates have | 
raged whenever intelligence testing is under consideration is 
Whether the individual differences such tests reveal arise mainly | 
from heredity or mainly from environmental influences. Psy- 
chologists, sociologists, educators, and many other varieties of 
scholars and professional men were concerned with this ques- 
tion because of what they thought to be its implications for so- i 
cial policy. As time has passed, the progress of research has 
Served to moderate extreme views and to show how the con- 
Cepts stressed by both hereditarians and environmentalists could 

е merged in more comprehensive theories of human develop- 
тет. To both questions intelligence testers have tried to an- 


Swer—'"Do differences in score reflect hereditary differences in 
e arise from differing < 


individuals?” and, “Do differences іп scor 
nvironments?”—the answer is “Yes.” 
B of all the environmental differences we observe in human 
2 lety, the one variety that influences mental growth most 
"arkedly is differences in education. The evidence for this state- 
ment comes primarily from retests of equated groups of subjects 
after considerable periods of time. Invariably the trend is for 
poe who have had more schooling to scoré significantly higher 
'an those who have had less schooling. An influential report 
94 Such а retest investigation by Irving Lorge is reprinted here, 
Schooling Makes a Difference," Teachers College Record, 1945, 


46, 483-492. It is reprinted with their permission. | 
of education for increased earn- 


the value of education for in- 
rs do not realize the value of 


in Educators recognize the value 
e Power. They also recognize 
ased knowledge. But educato 
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‘education for increased mastery of the abilities measured by in- 
telligence tests. 

Few studies have shown the influence of extent of education 
upon changes in intelligence test scores. Except for the Iowa 
Studies,! none has shown how increased educational advantages 
can influence the scores made on intelligence tests. This article 
is a report of the changes which occurred in intelligence test 
scores as related to extent of education for a group of boys who 
were studied over a twenty-year period—from the time the boys 
were about fourteen years old to the time they were about 
thirty-four years old. 

In 1921-22, some 863 boys іп the 8B classes of a representa- 
tive sampling of public elementary schools in the city of New 
York were given a series of tests of abstract intelligence, me- 
chanical adroitness, and clerical ability. The tests were given to 
ascertain the values of such appraisals in predicting subsequent 
vocational success. The boys were followed up at regular inter- 
vals to get relevant information about their subsequent schooling 
and subsequent work careers.” 


RETESTS AFTER TWENTY YEARS 


In May 1941, as the twentieth year of follow-up was nearing 
its close, the 863 boys were asked to come to Teachers College 
for some retesting. 

The primary objective of the retest program was to find out 
whether an intelligence test taken as a thirty-four-year-old is 
more predictive of vocational success than an intelligence test 
taken as a fourteen-year-old. The letter sent to these subjects 
stated that twenty years had passed since they had been tested 
and asked them to come to the College to meet with their ele- 
mentary school classmates, and to take some further tests. They 


1 Guy Montrose Whipple (Editor), “Intelligence: Its Nature and 
Nurture, Part I,” The Thirty-Ninth Yearbook of the National Society 
for the Study of Education (Chap. 14, pp. 405-41). Public School 
Publishing Company, Bloomington, Ш., 1940. 

? Edward L. Thorndike and others, Prediction of Vocational Suc- 
cess, Commonwealth Press, New York, 1934. 
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were told to bring their work records up to date, since these 
records had been of great value earlier in appraising aspects of 
vocational guidance, and each bit of additional information 
would increase their value. Each man was offered (and paid) 
two dollars for his time. During May 1941, 131 men complied 
with the request. 

Each of the 131 men was interviewed to complete his work 
record for the period that had elapsed since he was last seen. 
Each was asked to take the Minnesota Scale for the Survey of | 
Opinions and to fill out a questionnaire about his education, so- 
cial affiliations, ambitions, and opinions concerning guidance. | 
In addition, each took two tests of intelligence: the Otis Self- | 
Administering Test of Mental Ability, Higher Examination, Form | 
В (twenty-minute time limit), and Part Ш of the Thorndike 
Intelligence Examination for High School Graduates, Form V 
(one-hour time limit), The present article is concerned with the 
relationship of these tests of intelligence to those taken twenty | 
years earlier.* 6 


А REPRESENTATIVE SAMPLING 


On the basis of the scores obtained in the 1921-22 testing 
there was no statistically significant difference on any test be- 
tween the average score of the group of 863 boys and the aver- 
аре score of the 131 men W 
more, there was no statistically sig 
Theasure of variability of the 863 boys and 
additional check was made to determine whet 
Significant difference existed between the intercorrelations among | 
the six measures obtained in 1921-22 for all 863 boys and the | 


ts of the 1921-22 exam- | 


res on two clerical abilities tests, 
"тыу Test, а ОР test of intelligence. and a measure of school | 
We gress up to grade 8B (the second half of He en grade). r 1 
S i i men were а. 
possib] te whether the П 
Беер оа oup of 863 boys originally tested. 
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corresponding intercorrelations for the 131 men of the retest 
group. There were none. It is reasonable, therefore, to infer that 
the 131 men who came to Teachers College in May 1941 con- 
stituted a representative sampling of the total group tested 
twenty years before. Since the original group of 863 boys con- 
stituted a representative sampling of boys in grade 8B in public 
elementary schools in New York City in 1921—22, the retest 
sample may be considered representative of that group too. 

From a study of the relationships among the 1921—22 test of 
intelligence, the 1941 tests of intelligence, and the extent of 
schooling for the 131 men, it is possible to make certain gen- 
eralizations concerning the population of boys in the eighth 
grade in 1921—22. The score on the 1921 test of intelligence 
was a weighted composite of the scores from two different tests: 
the Thorndike-McCall Reading Scale and the LE.R. Arithmetic 
Test. Toops? has shown that this composite score derived from 
a reading and an arithmetic test measures essentially what is 
measured by other reputable group tests of intelligence. The 
1921 score, therefore, may be considered a valid indication of 
how these boys performed on intelligence tests when they were 
nearly fourteen years old. The two tests of intelligence adminis- 
tered in 1941 are reputable group tests of intelligence. For the 
131 men in the retest sample, the correlation between the Otis 
scores and the Thorndike scores is .82, suggesting that each of 
the tests measures similar intellectual performances. 


HIGHEST GRADE COMPLETED 


The extent of schooling was measured in terms of the highest 
grade completed in school. As such, it is comparable with the 
census definition of "last school grade completed." In arriving 
at the score for extent of schooling, the last school grade com- 
pleted was credited regardless of the kind of school in which 
it was completed. A person who had completed the tenth grade 


5 Herbert A. Toops, Tests for Vocational Guidance of Children 
Thirteen to Sixteen. Contributions to Education, No. 136. Bureau о 
Publications, Teachers College, Columbia University, New York, 
1923. 
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in an academic high school was given the same score as a per- 
son who had finished the tenth grade in a vocational high school, 
or one who had completed the equivalent of the tenth grade in 
an evening school, or one who had finished the equivalent of 
the tenth grade in a school established by the company by which 
he was employed. The extent of schooling as measured by the 
highest grade completed in school is, therefore, an undifferen- 
tiated mixture of quantity of education, kind of education, and 
quality of education. It does not reveal what the individual really 
gained from his education, nor is it an index of the quality of 
education he received. The highest grade completed is reported 
in whole numbers; thus, a score of 8 represents the equivalent 
of graduation from the eighth grade of elementary school, a 
Score of 12 graduation from high school, a score of 16 gradua- 
tion from college, and a score of 17 or more is indicative of one 
Ог more years of postgraduate study. 


INTELLIGENCE TESTS IN 1921 AND 1941 


The correlation between the scores on the 1921-22 test of 
abstract intelligence and the Otis intelligence test taken in 1941 
Was .64. The correlation between the 1921-22 abstract intelli- 
gence score and the score on the Thorndike test taken in 1941 
Was .62. There is no doubt that this is a rather high correlation 


between two different tests of intellectual performance taken 


twenty years apart, Robert Thorndike! has shown the correla- 
the same intelligence test 


Поп between the scores derived from 
(the Stanford Revision of the Binet-Simon Scale) taken five 
Years apart to be about .70. His data suggest that the correlation 
Would be substantially lower if the scores were taken ten, fifteen, 
БІ: lwenty years apart. There is approximately as much in com- 
ТЕ in the intellectual performance based on different tests taken 
i спу years apart as there would have been if the same test of 
ШМеШірепсе had been repeated twenty years later. 
= 

“Rober е. “ f the Interval Between Test 
id Ren i {шеша ды Tal 10." Journal of Educational Psy- 
OBy, 24:543—49, October, 1933. 
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THE VALUE OF SCHOOLING 


In an earlier study, on the basis of the repetition of identical 
tests ten years apart (1921—22 and 1932) it was found that time 
diminishes the predictive value of a test#for itself. Factors re- 
lated to maturation, environment (especially school), and the | 
test itself may be responsible for the general decrement in the 
correlation between scores on intelligence tests taken at widely 
separated times.? In the 1941 study, one of the environmental 
factors can be appraised. The value of the extent of schooling 
can be estimated by finding out whether the addition of the 
highest grade completed affects the relationship between the 
1921 and the 1941 intelligence test scores. The correlations be- 
tween the two tests of intelligence twenty years apart were .64 
with the Otis and .62 with the Thorndike. Does highest grade 
completed increase the prediction? The facts suggest a positive 
answer. The multiple correlation between the 1921—22 test of 
intelligence and the composite of the Otis and the highest grade 
completed is .79. The corresponding correlation between the 
1921—22 test of intelligence and the composite of the Thorndike 
and the highest grade completed is .77. The increase in the pre- 
diction from .64 to .79 and from .62 to 77 definitely suggests 
that extent of schooling does make a difference in the intelli- 
gence test score of a person twenty years later. 


RELATIONSHIP OF ADULT LQ. 
TO SCHOOLING AND CHILDHOOD Г.О. 


The extent of this difference сап be understood somewhat 
better from tables which show the relationship of the 1941 tests 
of intelligence to the 1921 test of intelligence and extent of 
schooling. Table 1 presents the average scores on the Otis test 
given in 1941 in terms of highest grade completed and the score 
on the 1921 test of abstract intelligence. The columns of the 
table represent the average Otis score іп 1941 for the men wh? 
had specified scores on the 1921—22 test of abstract intelligence. 


“Irving Lorge, "Retests After Ten Years," Journal of Educational 
Psychology, 25:136—41, February, 1934. 
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For instance, in the column headed 49-58 are presented the 
average Otis scores for the seven boys who had the lowest 1921 
scores. Four of these boys who did not go beyond grade eight 
made an average Otis score in 1941 of 14.0. One of these boys 
who completed the ninth grade made an Otis score of 19.0; an- 
other who completed the tenth grade made an Otis score of 24-0. 
Each column, therefore, shows the 1941 scores of men who may 
be considered to have been fairly equivalent in measured intellec- 
tual ability in 1921. | 

Тһе rows of Table 1 present the average Otis score obtained 
in 1941 for boys who had completed grade eight, or nine, OT 
ten, or above. For instance, in the first row (representing com- 
pletion of eighth grade only) the average Otis scores are given 
for men whose extent of education was constant, but whose 
1921—22 intelligence scores differed. Of the twenty-five men who 
had completed the eighth grade only, the four who had the 
lowest 1921—22 intelligence test score made an average of 14.0; 
of the same group of twenty-five, the one person who had made 
a score іп the 99-114 range of abstract intelligence test scores 
in 1921—22 obtained a score of 33.0 on the Otis test in 1941. 

Table 2 presents the corresponding data for the Thorndike 
Intelligence Examination for High School Graduates taken in 
1941 in terms of the 1921—22 test scores and the highest grade 
completed. | 

The two tables, therefore, give the information regarding the 
relationship between the 1921—22 test of intelligence and the 
1941 tests of intelligence, holding constant the extent of educa 

_tion (reading across the row), and the information regarding the 
relationship between the 1941 tests of intelligence and the extent 
of education, holding constant the score on the 1921-22 test of 
intelligence (reading down the columns). 

The facts in Table 1 and Table 2 definitely indicate that there 
is a substantial relationship between the scores on 1921 test of 
intelligence and the scores on 1941 tests of intelligence, holding 
constant the extent of education. The men who had completed 
only eight years of schooling show average Otis scores of 14, 
22, 21, 26, 39 and 33, depending on their 1921-22 intelligence 
test scores. For each row it is clearly evident that the average 
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score on the 1941 tests of intelligence is higher for those with 
1921-22. intelligence test scores in the range 99-114 than for 
those in the range 49—58. The data definitely suggest that a 
person's measure of intellectual ability taken as an adult 34 years 
of age is substantially related to his measure of intelligence at 
or near 14 years of age, regardless of the extent of his schooling. 

A. more important finding, however, is concerned with the 
variation in the 1941 measure of intellectual ability as related 
to the extent of education when the 1921—22 measure of intel- 
ligence is held constant. In Table 1, for instance, in the column 
representing the Otis scores of those who had а 1921-22 intelli- 
gence test score of 89—98, the scores tend to increase with the 
extent of schooling. The averages for eight, nine, and ten grades 
completed are 39, 38, and 37 respectively. The averages for the 
boys who had the same 1921—22 intelligence scores and who had 
fifteen or more grades of education were 53.5 and 54.5. In terms 
of the published Binet equivalents for the Otis scores, the mental 
age represented by scores of 37, 38, and 39 is approximately 16 
years 5 months, whereas the mental age equivalent of scores of 
53.5 and 54.5 is approximately 18 years 5 months. The mental 
age of the eight men in the range 89-98 with fifteen or more 
grades of schooling is two full years higher than that of the men 
who completed between eight and ten grades of schooling. Jf 
one used 16.0 as the reference chronological age to estimate 
1.0.5, the men who had completed fifteen or more grades would 
have І.О.8 of about 115 as compared with an average I.Q. of 
103 for those men who had completed only eight to ten years 
of schooling, although each of them had the same intelligence 
test score at fourteen years of age. The 1941 Otis scores for men 
who had completed thirteen or more grades of schooling аге 
substantially higher than those for men who had completed les | 
than twelve grades of schooling, holding constant the level of 
intelligence obtained in 1921-22. 

The tables reveal another finding of considerable significance. 
It should be noted that practically none of the men who had the 
lowest intelligence scores іп 1921-22 (49-58 and 59-68) made 
scores as high as the men who had obtained the highest intelli- 
gence scores іп 1921-22 (89-98 and 99-114). Education makes 
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a difference, but it would be overly optimistic to expect it to 
change the least able into the most able. 

The men highest in 1921-22 intelligence test score are differ- 
entiated according to the extent of education they obtain. The 
equally able men who had less than twelve grades of education 
obtain adult intelligence test scores substantially lower than their 
intellectual peers who had more than thirteen grades of school- 
ing. Insofar as an intelligence test measures ability to perform. 
intelligently, the men who did not have the advantages of more 
Schooling apparently are penalized by this lack of education. It 
must be recognized that superior intellectual ability needs stimu- 
lation, Intellectual ability is not lost as people grow older, but 

l the full potentialities of a person may be lost in the absence of 
reasonable opportunities and advantages. Genius may come out, 
but society ought to insure its emergence by providing appro- 
Priate educational opportunities. 


SELECTIVITY OF EDUCATION 


Education has been selective of the abler people in the popu- 
lation, The selection, however, has not been perfect. For the 131 
men involved in this study, the 1921-22 test of intelligence cor- 
Telated only .36 with highest grade completed. A correlation 
Coefficient of .36 would not permit very reliable predictions of 

9w much schooling a person would complete. The relationship 
etween the 1941 measure of intelligence and the extent of edu- 
Cation is much higher. For the Otis it was .67 and for the Thorn- 


ike it was .68. An intelligence test score obtained at or near age 
f education a person will 


d at or near age thirty- 


DER performances involved in t 
ension of them, the differences must be si 


AU 


e, 


182 INTELLIGENCE 


THE MEANING OF INTELLIGENCE 
TEST SCORES 


An adult's measured mental ability is related to his intelligence 
as a child and to the extent of his subsequent schooling. An in- 
telligence test score, therefore, is related not only to basic mental 
ability but also to the environmental opportunities to capitalize 
upon that basic ability. Intellect—that is, native intellect —can 
never be measured directly. Mental ability can be appraised only 
by its performances. An intelligence test is made up of items or 
situations each of which must be an environmental task. АП 
other things being equal, it is assumed that persons within the 
same environment can be differentiated according to their test 
performances, This assumption, undoubtedly, is not true when 
variation in the extent of schooling can differentiate the initially 
able persons' behavior on adult intelligence tests. Moreover, the 
test situations should ideally be a sample of all possible environ- 
mental tasks requiring intelligent behavior. Few intelligence tests; 
however, are ideal. Intelligence tests, whether for children or for 
adults, favor the tasks and situations experienced in schools. In- 
telligence tests deal with information, reading, vocabulary, arith- 
metic reasoning, computation, analogies, and the like. Insofar a5 
the tests favor the kinds of things taught in school, they will tend 
to favor people who have had the greater extent of schooling- 
At best, an intelligence test measures a person’s ability to deal 
with aspects of his environment at the time and up to the time 
of testing. It must be remembered, however, that an intelligence 
test measures ability to deal successfully with intellectual tasks. 
It is not an adequate measure of the individual's personality; 
adjustment, happiness, or vocational adaptation. 

Higher scores on intelligence tests, however, can be interpreted 
as meaning better ability to deal with the intellectual environ- 
ment. If higher scores can result from experiences in a more 
stimulating environment, or from the experiences in environ- 
ments that favor the sort of things measured on intelligence tests, 
then society should seek to get the higher scores that do repre- 
sent mastery of the intellectual environment. Intelligence tests 
show some of the consequences of the school environment. Some 
able individuals, however, are denied opportunity for maximunt 
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realization of their full potentialities when they cannot get all 
the education they desire or deserve or need. 


FACTORS IN GOING TO SCHOOL 


The extent of education is not solely related to intelligence. It 
depends upon economic circumstances, upon society's attitudes | 
toward minorities, upon familial attitudes toward schools and 
learning, and upon society's ability to support education. These | 
are but a few of the factors that are related to extent of school- | 
ing. Sibley? has shown not only that the most intelligent boys | 
have a four-to-one advantage over the least intelligent in extent 
of education obtained, but also that the sons of men in the eco- 
nomically advantaged groups һауе a ten-to-one advantage over 
the sons of men in the lowest occupational groups. Davis? has 
Shown that in the state of Kentucky about half of the best *col- 
lege risks" did not enroll in college, while about à seventh of the | 
Poorest "college risks" did enroll. Among the best that did not 
80 to college or the poorest that did go, the economic factor | 
Was the primary reason for not going among the ablest, or for 
going among the poorest. Karpinos and Sommers® definitely in- 
dicate that highest grade completed is dependent upon income | 
level of the family, geographic region in which the person lives, 


and color. The facts revealed by the 1940 census? are evidence 
that economic circumstances and color are related to the extent | 
9f education. For adults twenty-five years of age and over, those | 
Tesident in rural-farm areas average 7.7 years of completed | 


Clues to Stratification,” | 


E 


Кт 

bridge Sibley, "Some Demographic 
American Sociological Review, 7:3; 322-30, June, 1942. . 

Horace Leonard Davis, "The Utilization. of Potential College | 
Ability Found in June 1940 Graduates of Kentucky High Schools,” | 
Bulletin of the Bureau of School Service, College of Education, Uni- 
versity of Kentucky, 15: Мо. 1, P- 101, September, 1942. 


5 Bern, i Herbert J. Sommers, *Educational At- 
ad DART m Income Classes," Elementary 


‘ainment B = 

of Urban Youth in Various 

School Journal, 42:611-87, May, 1942: 766-74, June, 1942. 

Henry S. Shryock, Jr. “1940 Census Data on Number of Years 

53 School Completed," The Milbank Memorial Fund Quarterly, 
3367-87, October, 1942. ' 
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schooling, whereas those resident in urban centers average 8.7 
years. The average years of completed schooling for urban Ne- 
groes was 6.8 as contrasted with 4.1 for Negroes in rural-farm 
areas. 

Тһе variation in the extent of schooling by region, state, color, 
and rural and urban residence suggests that many individuals in 
our society are denied through no fault of their own the oppor- 
tunity for the fullest development of their potentialities. Since 
the evidence from this study indicates that limitations in fullest 
intellectual development may result from artificial restrictions in 
extent of education, society is losing tremendous amounts of its 
fundamental human resource. Educators, sociologists, and others 
must prevent the loss of society’s human resource because of 
inadequate provision for its nurture. 


SCHOOL ATTENDANCE vs. HIGHEST 
GRADE COMPLETED 
( 
- Tt should be noted, however, that extent of education and 
amount of time spent in school are not synonymous. Keeping 
- children in school to keep them out of the labor market or off 
the streets is not necessarily related to maximum development. 
ý In many ways it may even have undesirable results. A distinc- 
tion must be made between years of school attendance and the 
highest grade completed. Thorndike! has shown that there is 
no relation between the number of years of school attendance 
and measured ability, but that there is а significant relationship 
- between the highest grade completed and measured mental abil- 
ity. He studied the forty boys of a group of more than seven 
- hundred who had obtained the highest scores on a test of in- 
telligence as contrasted with forty boys of the same group who 
| had made the lowest scores оп the intelligence test. He found 
that, on the average, the ablest forty were only four months older 
- than the least able forty when they left school. The ablest forty, 


* Edward L. Thorndike, “Тһе Distribution of Education," Тһе 
School Review, 40:335-45, May, 1932. 
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however, achieved high school graduation as contrasted with 
graduation from the eighth grade by the least able forty. Thorn- 
dike's study concerned itself with boys who were in school at a 
time when retardation was more prevalent than it is today. Some 
of the least able individuals in the group repeated grades twelve 
or more times, that is, they were “left back" or “held over" dur- | 
ing their school careers an aggregate of six or more years. His | 
study emphasizes that "going to school" and "getting something 
Out of school" are not the same thing. : 
The correlation obtained by Thorndike between number of i 
years in attendance at school and measured intellectual ability | 
Of an adult is about zero. School attendance, which includes | 
repetition of school grades for the least able and "skipping" b 
grades for the most able, is unrelated to an adults measured | 
mental ability. There is, however, a significant relation PET 


the highest grade completed and an adult's mental ability. Бог; 
the enlisted men іп the United States 


Army during World War | 
I, the correlation between highest grade completed and meas- і 


ured mental ability was between 160 апа .70. Тһе correlation sug- 


gests not only selective screening by schools, but also the in- 


Crements to measured mental ability accruing as a result of - 
education. Insofar as the 1921-22 tests of abstract intelligence 
represent a fair measure of ability under similar circumstances, 
the data indicate that increments in adult intelligence test score 
are related not only to original Jevel of intelligence, but also to the | 
extent of education that could be obtained. It should be obvious, | 
therefore, that an intelligence test score of an adult cannot be 
interpreted as direct evidence of original inherent ability. On the | 
Contrary, the status of an adult on ап intelli 


gence test represents - 
the interaction between his basic ability and the ma 
of his environment. 


SUMMARY 

Schooling makes a difference in a person’s score on the intelli- 

gence tests that he takes as a mature adult. These differences аге 

Important not only for the individual but for society. Society. 
; 
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13 
Deprivation, Development, and Diffusion 


SusaN W. GRAY AND RUPERT А. KLAUS n 


As American society has become increasingly concerned with 


poverty and the “culturally deprived,” the consistent finding that — 


the amount of schooling obtained is related to the intellectual | 
bout the sizable proportion | 


level attained has led to a concern а 

of the nation’s school children who start out with below-average | 
intelligence and who do not seem 10 profit very much from their | 
School experience. AS early as the 1930's, а controversial body | 


of research results, the so-called Iowa studiés, seemed to indicate | 
that it is early experience that has the most marked effect оп | 
intellectual development, and that preschool education of three- 
year-olds апа four-year-olds сап stimulate such development. / 
With the general progress of knowledge about the effects of | 
early experience on development, it was possible during the * 
1960's to set up research investigations that would be more 
definitive than the Iowa studies of thirty years before. One of | 
these was undertaken at George Peabody College. The paper | 
reprinted below is a report on the 


procedures апа preliminary 
results by Susan W. Gray and Rupert A. Klaus entitled “Рергіуа: 


^ [t is an abridged version of 


chologists, Sept. 4, 1966, and is терті! 
the authors. 
talk with you about a research | 


Study just entering its sixth year, one that is concerned with the | 
experimental testing of ап intervention program designed to im- | 
deprived children. This study, the. _ 

{ 

4 


Prove the educability of young ду, th 
it its short name, grew originally | 


Early Training Project, to give | name, gr inall 
Out of the concerns of the school administration in the city "ny 
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This afternoon I should like to 


1%. 
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which the Peabody program in school psychology maintains a 
field and practicum center for its students. 
' One problem, of several mentioned by the superintendent of 
schools, as the staff of the Peabody school psychology program 
talked with him about research possibilities, was that of the pro- 
gressive retardation in achievement shown by the children in 
one of the city schools, a school which was all Negro, and іп 
which as many as 75 per cent of the children came from de- 
| prived backgrounds. After some preliminary data gathering by 
. students in the school psychology program, it became clear not 
- only that such progressive retardation did exist, but also that the 
majority of the children were at a substantial disadvantage in 
| the beginning, as shown on reading readiness tests and on first 
grade achievement. 
And so, largely for practicum experience for students in plan- 
ming research, in carrying it out, evaluating the results, and іп 
aining actual experience with young children, we designed а 
“special ten-weeks intervention program to conduct with a group 
f deprived children for ten weeks prior to entrance into the first 
grade. 
The results of this study intrigued us enough that we decided 
to plan a more extended one. And so, Rupert Klaus and I began 
in 1961 to plan a new intervention project with which we would 
begin much earlier with children, provide a more massive ex- 
“perience for them, and involve the mothers to a greater extent 
than we had done in the pilot study. 
__ This study, The Early Training Project, from the standpoint 
of its design, the nature of the intervention program, and cer- 
tain of its interim results, has been described in previous papers 
of this association and elsewhere. I should, therefore, like to 
spend my major time this afternoon in describing the long term 
results of the study—at least through the past summer. Since 
many of you, however, are probably not acquainted with the 
study, I hope others will forgive me if I take fifteen or so min- 
utes to review the design of the study, the general rationale on 
which the intervention program was based, and the actual op- 
eration of the program. 
Our general strategy grows out of the fact that at the time we 
began, research in the field had not yet demonstrated whether 
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it is possible to offset substantially the progressive retardation | 


commonly observed in deprived children in their years of school- 
ing. It is true that several studies had demonstrated a 5 to 150 
points IQ gain in young children with special interventions no 
longer than three months. These gains, however, tended to be | 
temporary, and are probably explicable in part by the changes | 
in motivation from pre-test to post-test associated with experi 
ences in which children learn to respond to a range of adults, 
particularly verbally, and to become somewhat task-oriented. 
Our effort was to design an "experimental package of best 
bets" for intervention. This package was based upon available 
research on social class, cognitive development, and motivation. 
From such research we attempted to derive those characteristics 
Which appeared to be related to the differences in school per- 
formance of middle class and culturally deprived children and 
Which also appeared to be subject to possible manipulation. Since 
We were concerned with school applications, as well we at- 
tempted to do this within a framework it would be possible ti 
duplicate, on a wide scale, should the project prove to be suc- 


cessful. 
Our general aim was 
opmental rather than re 


to make our intervention program devel- 
medial. Thus, we planned to begin at ап 
f children. Three of thes 
f 65 deprived childrej 


rn city. One of these groups had 


Visits during the remai 
home visitor whose tas 
In activities similar to those o 
Bive the mother some help in 
involved in enabling her ch i 
educationally and vocation 
intervention schedule, exce 
thus involved only two summe 
had the services of the home vi 
third group served as the local c 

in a town similar in economic structure, but 60 miles distan 
Served as an additional control group. This last group was adde 
to the design since we anticipated the possibility of diffusion into 
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he control group in the small city in which we worked; we 
oped by the additional group to arrive at some estimate of such 
liffusion effects. . 


ГНЕ NATURE OF THE PROGRAM 


The preschool summer experiences for each group were ar- 
ranged so that each group of approximately 20 had a head 
leacher, plus three or four assistant teachers, the assistants be- 
ing largely trainees in our school psychology program or under- 
graduates especially recruited for the program. . . . The high 
ratio of adults to children was of particular importance for the 
form of intervention we planned. The staff was about equally 
balanced as to race and as to sex. We made especial efforts to 
have men teachers in the group to serve as appropriate role 
models for the little boys, particularly those from father-absent 
homes. ... д 
3 One of the two main classes of variables with which we were 
concerned in our summer program was that of attitudes related 
to achievement. Our paramount concern here was with achieve- 
ment motivation and such related characteristics as the ability 
10 persist and to delay gratification. During the first summer we 
found that gross motor activities appealed greatly to the young- 
sters and were one of the better ways to arouse their motivation 
to achieve or excel. . . . 
© Block building also served as а way of encouraging children 
to better their previous performances or those of others, Atten- 
tion paid to the objects they were able to produce was something 
new to these youngsters. We mounted their pictures on the bul- 
letin board, admired their little clay bowls, and their magazine 
‘cutouts. 

The teachers served as reinforcing agents for the youngsters. 
Close physical contact, with the undivided attention of an adult, 
“was one of the most effective reinforcements we found for the 
“children. Father-figures were especially important for the little 
“boys from father-absent homes, although the little girls as well 
enjoyed male attention. The adults thus could set the pattern 
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of approved behavior for the youngsters and themselves serve as _ 
achieving role models for the children. EN. 
1 Since we were working with Negro children, we were par- | 
ticularly concerned with the problems of self-esteem which the | 
Negro child experiences in the WASP world he encounters in. 
the mass media, in school, and in the world at large. . .. —. 

In terms of general cognitive development, we were first con- 
cerned that the children acquire some of the more elementary - 
ways of classifying their world, of seeing similarities, and асай 
ences: 7.. \ 

Since the youngsters seemed somewhat retarded in perceptual | 
discrimination, we worked with many types of material that | 
would help increase their ability to see likeness and differences, | 
to see relations of parts. . - - 

Language was, of course, of major concern to us, and we 
used many ways of trying to develop it. Telephones were a natu- - 
ral for such efforts and greatly enjoyed by the children. . . + 
One inch cubes were put to use for learning position words and 
the like. .. . The old nursery rhymes were often used, and | 
enacted to the children's delight. . . - We used songs, rhymes, - 
and dramatization, not only to help develop language but also 
to promote a liking for school-type activities, most of which were. 
foreign to the children's home situations. Most of all we read to 
the children, and presently had brought them to the place where 
looking at books became an absorbing activity. ! 

We have been a little dubious about the term “enrichment” 
as applied to a project such as Ours, since the term suggests. 
throwing a lot of new experiences at children, without appro- 
priate concern for whether the children have developed the 
ability to process the new information that comes their way... « 
We tried to insure that new experiences . - · should be paced: 
and sequenced in such а way that the child could make use of 


the new information provided. 
Some of these new experiences ' | 
easel and tempera paint, or in looking at one's hands through a 
tripod microscope. Even trying to blow up а balloon was à 
challenge to some of these youngsters. Rhythm instruments were 
highly attractive to the youngsters and useful for teaching such 


x 


were as simple as using an 
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new meanings as together, faster, louder, softer, and the like. 
We took them to farms, where they had a chance to explore 
chicken houses, to see the baby calf, and to feed the pigs. A 
young man brought to school his mare and two-weck-old foal 
‘that was bottle fed. Those who had the courage were allowed, 
to take a ride on the mare. We visited an air base, a fascinating 
and somewhat overwhelming experience for these youngsters. 
I fear this was one time they got more information than they 
‘could process; they came home as if they had been on a lost 
"weekend. We took them to the children's museum, which was 
a little beyond them, even during the third summer. The diora- 
mas and the live animals, however, bore enough resemblance 
‘to the animals they had seen on the farm and in their picture 
books to intrigue them. 
7% We took them to the library, somewhat with fear and trem- 
bling as to their behavior. The trip was a success, however, and 
was followed up by the home visitor. Prior to the visit, only two 
of the mothers had ever been to the library. After the trip, and 
particularly with the efforts of the home visitor, we were able 
to get all of the mothers except two to visit the library and to 
ake out library cards. . . . 
-. Over the five years that we have been working with the Early 
‚ Training Project, we have managed to collect a whole mountain 
үт ange of data—and the end is not in sight; we find the progress 
of our children and their families through school, in these times 


- of rapid educational and social change, much too fascinating to 
- let the study drop. 

Before going into the analysis it might be helpful to describe 
$ briefly some of the observable differences in the four groups that 
do not relate to intervention but rather to the vicissitudes of 
randomization. - - . [Table 1] gives the breakdown of the chil- 
dren remaining in the four groups as they looked at the initia- 
_ tion of the study. Virtually all of the children are still with us. 
On none of the indices that you see were the groups statistically 
"different, although the IQ difference between T; and Т, was а 
‘squeaker. When we have gone back and examined the home 
ї situations, T» seems a favored group as compared to T,. There 
are twice as many father-absent homes in Т, as in Т.. Precise 
estimates of income are difficult to come by in these families. 
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TABLE 1 


Status іп May 1962 of Four Early Training Project Groups 
Used in 1966 Analyses. 


т T? т Т4 

(Ехрег.) (Ехрег.) {Local Control) (Distal Control) р 
CA tmo.) 45 4 41 5 
Binet MA (mo.) 39 42 41 4% 
Binet 10 86 91 8t Ы 88 
РРУТМА 3 20 28 32 
PPVT (raw score) 19 20 18 2 


— i OO 


The best comparison we could make in 1964 indicated that thi 
income, while low in both groups, was approximately double in 
Tə what it was in T}. This point would not be worth laboring; 
except that, with Т. being а more favored group, it is difficul 
to make comparisons of the effect of the longer intervention with 
T, as compared to the shorter one with Т». The only time thai 
significant differences have consistently appeared between these 
two groups was prior to intervention, Because of the differences 
in the two groups, we believe that we can say very little, if any- 
thing, about the relative effectiveness of the two lengths of treat- 
ment which we employed. The other three groups appeared mor 
Similar on family indices. If we had to rank them in terms 0; 
Beneral favorableness of the family situation, we would rank Ty 
first, T, second, Тз third, and T; fourth. 

. Probably a word should also be added about the differences 
In the two communities, m 
Paring local and distal control groups. The general economi 
situation in our major city is a atic 
least is increasing more rapidly), and the school system is slightly 
Superior, as well as we can judge. On the other hand, the gen- 
eral economic situation of the Negro is better in our distal cit у, 
and has been so for many years, because of the presence o 
Certain major industries that have hired Negroes in well-payin; 
Positions. We believe now, as we did at the time we chose th 
distal city, that it is the best match we could find. We have been 
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troubled, however, by certain differences in the school system, 
and for this reason have tried where possible to make compari- 
'sons that would take this into account. 

From 1962 through 1964, we have pre- and post-tested all 
four groups in the months before and after the special summer 
‘school. Routinely we have used the Binet and the Peabody Pic- 
ture Vocabulary Test (PPVT). Starting in 1964, just prior to 
‘school entrance, we added the Illinois Test of Psycholinguistic 
Abilities (ITPA) and the WISC. These last two have been given 
"олсе yearly, and ће WISC has been alternated with the Binet. 
T should like first to go into our analyses of these data. 

Our method of analysis has been to use Lindquist mixed de- 
signs, Type I, III, or VI, whichever was appropriate to our data. 
Where significant Fs occur, as they have in our data, we have 

- used orthogonal comparisons to locate the sources of differences 
vin groups. We have thus compared T, and Т, combined with 
Т, and Т, combined, and then made additional orthogonal com- 
parisons of T, and Т, and of Т; and Т: These seem to us the 
"most meaningful group comparisons for assessing the effects of 
our intervention program and of diffusion effects. 

Now for the Binet. Figure 1 gives MA scores from May of 
1962 to June of 1966, a period of 49 months. At all points since 
intervention began with Т», we have found significant Fs for the 
comparisons of the experimental and controls. The general curves 
l are ones of i increasing divergence up to school entrance and then, 
E the school years, some closing of the gap. As you can see 

from the graph, the greatest difference in groups was just prior 
to school entrance. At this time T, had shown an IQ gain of 9 
| points and Т, of 5 points, while the local and distal control 
groups had lost 4 and 7 points respectively. You can also see 
‘that the curves maintained approximately the same slope for 
_ the experimental groups during the first grade (August 1964 to 
_ August 1965) while both of the control groups showed some 
acceleration. Also apparent is the slight deceleration straight 
across the groups in the past year. None of the four groups in 
this last year made as many months of gain in mental age aS 
might be expected with “normal” progress. This is a finding to 
- which I wish to return later. 
Now for the WISC (Figure 2). Since I thought you might be 
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BINET MA— SCORES (MOS.) 
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Scaled Score Means for ETP Experimental and Со 
а, (1964, 1965. and 1966 Combined) 
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PPVT-MA SCORES FOR TRAINING AND CONTROL GROUPS 


o 
o 


a 
о 


MA - SCORES (MOS.) 
a 
o 


ы 
о 


m 
o 


Moy Aug May Aug Moy Aug June Aug June 
1962 1963 1964 1965 1966 
Fig. 3. 
| 


interested іп the sub-tests, we have combined the three ad- 

ministrations. In general, the profiles are similar at all ages- 

. Here you can see the striking deficiency in vocabulary, and the ^ 

slight superiority shown on similarities. Experimentals are su- 

. perior to controls on six sub-tests: information, arithmetic, VO- 

cabulary, picture completion, block design, and object assembly. 
On the Peabody Picture Vocabulary Test (Figure 3), you see | 
a graph somewhat similar to that for the Binet, in that you have 
a divergence of experimental and controls once intervention has 
begun, with considerable closing of the Bap in the second year 
of schooling. In 1966, the experimentals are still superior to the | 

- controls, and the local control group is superior to the distal. 4 
one. 

[Figure 4 gives] results on the ITPA. . . . The three testings 
have been combined to give some notion of the general profiles. 
Here you can see that the differences are not great, and that the | 

profiles of the experimental and control groups are almost | 
parallel. The most conspicuous score is probably that on Auditory | 

Vocal Automatic. Those of you who are familiar with the test 
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ILLINOIS TEST OF PSYCHOLINGUISTIC ABILITIES. 
EXPERIMENTAL AND CONTROL GROUPS: COMBINED 1964, 1965, 1966 SCORES 


Auditory Decoding 
Visual Decoding 


Auditory Vocal Association 


Visual Motor Association 
Vocal Encoding 
Motor Encoding 
Auditory Vocal Automatic 


Auditory Vocal Sequencing 


Visual Motor Sequencing 


Total Language Age 


Fig. 4. 


nds the sounding of final | 
hich these children come, - 
deficient in pronouncing 
bly are continuing ће | 


Will recall that this sub-test дета 
Consonants, The sub-culture from W. 
lower-class southern Negro, is generally 
final consonants; these children presuma i x 
Pattern acquired in their homes. Іп the Type VI Analysis of Vari- - 
ance which was performed, there was 4 significant group effect, | 
а Significant sub-test by administration, and a significant sub-test 
Y group interaction. Sub-analyses indicated that, insofar as the 
effects of intervention go, differences are largely attributable to 
the performance of experimental and control groups on the. 
1964 administration; they do not differ appreciably thereafter. | 

. So much then for the summary of our tests which have been 
Biven over time. From them I believe the picture is relatively 
Clear that the maximum effect of intervention was obtained just 
ТАН to school entrance, exactly me поа ee P 

Ough di in experimentals and controls ‹ г Бі 
nificant ers did PVT and the WISC, the differences are 


Of somewhat smaller magnitud 
gnitu е. 
But these tests were used largely 85 bench marks. In the Early. 
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Training Project our concern has been chiefly with what happens 
in terms of school performance. Before trying to interpret these 
bench mark data, then, I should like to give you a picture of 
what has happened in the first two years of public schooling. 

Like many others, I am somewhat skeptical of the adequacy 
of achievement tests in the first grade, and even in the second, as 
predictors of general school competence in the later years. Still, 
along with the measures already described, they are about the 
best we have available at present to answer the question of im- 
provement of educability. . . . 

Table 2 refers to first year performance on the Metropolitan 


"Achievement Test . . . First, if you will, look at the bottom 


1 


section of the table where the four treatment groups are com- 
pared, plus another group, which is included because it терге- 
sents а comparison with children who presumably had little con- 
tact with the experimental and control children. You can see 
from these scores that typically the experimental children score 
a little higher than the local controls, and the local controls à 
little higher than the non-ETP group, and at about the same 
point as the distal control group. None of the differences in the 
two experimental and the two control groups are significant. 
Gam of the differences, especially between the two control 
groups, are sizeable, but the large variance meant that differences 
are not significant, except in the case of word knowledge, where 
T; is superior to T4. 

Although the differences are not significant, their general pat- 
terning prompted us to inquire a little more into first grade per- 
formance in the schools, with particular concern for the possi- 
bility of diffusion from the experimental to the local control 
group. I might add that this general patterning showed up on 
practically every measure we took upon the children during the 
first year. A. Kendall Coefficient of Concordance for thirteen 
measures upon the four groups was .86 (p € .001). 

With the hunch that the introduction of 43 experimental chil- 
dren into the first grade of 91 children might have an effect 
upon over-all first grade performance, we next looked at per- 
formance scores on the Metropolitan Achievement Test, which 
were available at the two schools. These data you can n in the 
top two sections of the table. In the local School (where the 1962 
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TABLE 2 


204 Training Project First Year Scores. Annual Median Grade 
quivalent Scores on Metropolitan Achievement Test, Primary 
Battery; First Grade; (norm = 1.8). 


Word Word 
— н кш Diserim. Rexing АНЬ 
Local School. 
ЕА а Le LT 1.72 1.64 
КА 88 (6 19. m2 1.42 
МЫ 89 1.63 1.58 Іт 157 
9 Ln LT 1.87 143 y 
Distal School f 
S Li 16 1.64 Le 1.47 44 
НА 82 158 19 1% 145 
1 81 1.47 12 154 141 
Б ш 142 13) 152 19 
I кт; 5 Ln 1.73 1.89 1.61 | 
№ p 18 1.65 1.15 115 1.38 \ 
On-ETPdeprived(loca — 9 1.48 1.50 151 1B { 
4 133 1.30 154 1.28 ү 


data were not available in usable form) sco 


по patterning until one reac 
Perimental children were in first grade. In this case there does 
Seem to be a general improvement, except in arithmetic. This is 
Most conspicuous in reading, which is probably the best pre- 
dictor of these four scores for future achievement. 

In the distal school, another ges, which is one of 


pattern emer, 
а slight but consistent decline ove . 
may be related to an increase 


is some informal evidence that this t 
in the number of children from relatively deprived backgrounds 
mostly guess work. г 


Who have entered the school, but this is 
nerally inferior perform- - 


One thing that troubles us is the ge j 
ance of the distal school. As a partial check on the differences 


in Schools, we went back to look at the performance of the older 
Siblings of the children in the two experimental and the two 


Control groups, on the assumption t 1 
adequacy of the schools should appear in the older siblings" test 
Scores, and that these would be relatively independent of апу 
treatment effect of our interve 
gain scores for these children, 


r the past four years. There | 


res appear to show | 
hes 1965, the year in which the ex- | 


hat differences in the general 


ntion. This we did, and calculated | 
from a first to second testing On | 
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the Metropolitan. In this comparison there are no significant 
differences in the amount of gain shown by the older siblings of 
Т, and the local and distal control groups. The older siblings of 
T», however, made significantly more gain, part of the picture of 
the greater adequacy of the T, families already mentioned. Since 
T, and Т, showed the same patterning as Т., we are inclined to 
think that we are not dealing simply with a comparison of two 
school systems but may be dealing instead with a phenomenon 
of spread of effect, which we have termed horizontal diffusion. 
I should like to return to this in a moment, after we have looked 
- at achievement test scores for the second year. 
= First for the results on the Stanford Achievement Test (Table 
3). Three things, I believe, emerge from this table. First, and 
| regrettably, none of the groups is performing up to grade expec- 
tation, since at this point they should have been at approximately 
E. in mean grade equivalent. Secondly, the experimental chil- 
dren are superior to the control children in four of the six tests, 
as сап be seen at the bottom of the slide. Most of the variance 
here, however, was contributed by the distal control group. On 
these same four tests, the local control group is superior to the 
distal control group. 


TABLE 3 


Stanford Achievement Test Scores Mean Grade Equivalent, May 
1966. 

i -_-—aaes——— aaaaaaaaaaaaaaaaaamamamasmamamasaIiÃiIiA 

Word Para. 


Word Study 
Reading Meaning Spelling Skills Arithmetic Vocabulary 
CESARE SLE эшч Чы ee M E 


4 
Ті (Exper) 22 24 22 2.0 19 19 


T2 Exper.) 22 24 1.9 22 22 1.9 


2 T3 (оса! Control) 24 2.2 22 23 24 19 


Ta (Distal Control) ІЛ 1л 2.0 16 17 17 
т E nm m n 152 NS. m +> M+ NS 
Е * T, T4*T, 
1-%; mn ABT LM 


B» УАН 524 13914 


ысы = түт уын 
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TaBLE 4 


Metropolitan Achievement Test Scores, 1966. Mean Grade 
Equivalents and Gains from 1965 Administration. Я 


Word. Word 


Knowl. Disc. Reading Arithm. 
Т (Exper.) Mean 23 2.6 25 24 i 
Gain from "65 .6 49 л .8 , 
| 
Т (Exper. Mean 2.5 21 2.8 2.6 
Gain from 5 .8 1.0 48 .9 | 
Ty (Local Control) | Mean 23 2.6 2.6 25 A 
Gain from '65 .6 .9 .8 LI I 
Ty (Distal Control) Mean 20 22 21 20 
8 
Gain from '65 -6 9 6 d 4 
Significant Differences In Means qm № 4%)» 12% 
+T mT) 
тл; S Th ту, р 


Now for the Metropolitan Achievement Test results (Table f 
4).... [This table] shows much the same picture as was 
Shown with the Stanford Achievement Tests insofar as the telar | 
tive status of the several groups is concerned. Again, most of 
the variance is contributed by the fourth group, although it is 
only on arithmetic that it is inferior to the local control group. | 
An additional feature of this table is that it shows the mean 


gain since the time that the children were tested a year earlier, 
slightly less than average progress On. 


approximately .9 of a year, whi 
" How do we make sense oU 

Since we began intervention, ап 
We can begin with the perpetual cry 
We need more data before we 
sions, Indeed we do, particularly since 

achievement tests are not th 
be rash enough to try to interpret our data and at the same 
time to give you a little more information that may shed some 
light on these findings. tib Y. 
First, we might try to explore possibilities as 10 why the local 
ws 
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control group in general performs more adequately than the 
distal control group. Differences in school systems are a distinct 
possibility, although you may recall that we did not find differ- 
ences in gain scores for older siblings between the two schools, 
with the one exception of the T» group. The other possibility is 
that of diffusion into the local control group. The data you have 
seen, particularly the jump in first grade performance in 1965 in 
the local school, suggest this possibility. This we might term а а 
product of diffusion. We have also been interested in the process 
of diffusion within the community. Our home visitor has sup- 
plied us with some evidence, mostly of an anecdotal character. 
My favorite is about the mother of twin boys in the local con- 
trol group. Although she had only a passing acquaintance with 
the woman next door, when that woman's child was selected for 
the first experimental group, she became a daily visitor. Whatever 
things the experimental child brought home from school, ОГ 
whatever the home visitor left with her, such as books and draw- 
ing materials, the twins’ mother bought for them. They are now 
. very.competent little boys. In a little more data-oriented way, We 
have, through our home visitor's contacts, been able to establish 
fairly well certain patterns of kinship among the three local 
groups. . . . [Figure 5] shows that all groups are related, al- 
_ though Т, and Т, are more closely so than is either group with Тз. 
After two years in the homes of the children, the home visitor 
' was also in a position to estimate with fair accuracy the number 
of sustained contacts between experimental and control families. 
This is shown in [Figure 6]. . . . Here you can see that there is 
| only one child in the local control group from a family that has 
no direct or indirect contact with an experimental family. In 
six cases, a child has at least two direct contacts. 
We have also been interested in the process and product of dif- 
A fusion within the family group, which we have called vertical 
_ diffusion to distinguish it from the diffusion across groups, which 
4 we have termed horizontal. We have already analyzed data on 
E57, younger siblings of the Early Training children; the results 
| n this analysis are shown on the next table (Table 5). These 
results do not admit of an easy interpretation. One might expect 
that, if diffusion is taking place, the younger siblings should be 


Й superior to their matches in the experimental groups. Instead, 
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control group in general performs more adequately than the 
distal control group. Differences in school systems are a distinct 
possibility, although you may recall that we did not find differ- 
ences in gain scores for older siblings between the two schools, 
with the one exception of the Т group. The other possibility is 
that of diffusion into the local control group. The data you have 
seen, particularly the jump in first grade performance in 1965 in 
the local school, suggest this possibility. This we might term а 
product of diffusion. We have also been interested in the process 
of diffusion within the community. Our home visitor has sup- 
plied us with some evidence, mostly of an anecdotal character. 
My favorite is about the mother of twin boys in the local con- 
trol group. Although she had only a passing acquaintance with 
the woman next door, when that woman's child was selected for 
the first experimental group, she became a daily visitor. Whatever 
things the experimental child brought home from school, or 
whatever the home visitor left with her, such as books and draw- 
ing materials, the twins’ mother bought for them. They are now 
very. competent little boys. In a little more data-oriented way, We 
have, through our home visitor's contacts, been able to establish 
fairly well certain patterns of kinship among the three local 
groups. . . . [Figure 5] shows that all groups are related, al- 
though T, and T, are more closely so than is either group with Тз. 
After two years in the homes of the children, the home visitor 
was also in a position to estimate with fair accuracy the number 
- of Sustained contacts between experimental and control families. 
l This is shown in [Figure 6]. . . . Here you can see that there is 
i only one child in the local control group from a family that has 
no direct or indirect contact with an experimental family. In 
Six cases, a child has at least two direct contacts. 

We have also been interested in the process and product of dif- 
fusion within. the family group, which we have called vertical 
diffusion to distinguish it from the diffusion across groups which 
we have termed horizontal. We have already analyzed data on 
27 younger siblings of the Early Training children; the results 

of this analysis are shown on the next table (Table 5). These 
| results do not admit of an easy interpretation. One might expect 
. that, if diffusion is taking place, the younger siblings should be 
superior to their matches in the experimental groups. Instead, 
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TABLE 5 


Binet IQs of Early Training Project. Children with Younger 
Siblings of Testable Age, 1964. 


т; тз T4 
r (Local Control) | (Distal Control) 
N CA 10 N CA IQ N CA IQ 
(Mos) (Mos) (Mos) 
Total Group 21 48 91 19 47 87 26 46 8 
Project Children with 
Younger Siblings 
(Initia Testing) 16 47 89 7 50 %4 12 48 88 
Younger Siblings 
(Initial Testing) 21 53 83 95 т м 62 74 


scores are the same in the first group (which had the longest pe- 
tiod of home visitor contacts) while a 5 point discrepancy is shown 
in the second group (with the shorter intervention period). Both 
of the control groups, however, show discrepancies of at least 
13 points. These differences are significant. Our guess, which 
we have not been able to test adequately as yet, is that the 
younger siblings’ scores, across the board, are slightly depressed 
by three possible factors: (1) they were older at the time they 
Were tested, as you сап see from the table; (2) there may have 
been a consistent examiner bias since the same person tested all 


four groups; and lastly (3) we have a notion, on which it is 
difficult to find or gather har 


a variable in test performan 
tional child places a heavy 
money, time, energy, 
yet younger siblings 
analysis of their scor 
lem. 

Next, and finally, 
dispersion, to follow 


се in deprived families. Each addi- 
drain on the family's resources of 
and affect, We have just finished testing 77 
of the project children. We hope that our 
es will shed a little more light on this prob- 


we might look at what I am inclined to call 

the three D's of my title. Does the effect D 
а preschool intervention program inevitably wear off over time? 
Some people claim this and offer data to substantiate it. Other 
persons, such as David Weikart, have some hard data suggesting 


an effect that lasts well into the school years. I suspect it depends 


d data, that ordinal position may be | 
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on nature of the program. We believe that our data—so far— 
Show two things. One is that a program of preschool intervention 
45 extended as ours and as tailored to the problem can have last- 
ing effects. Our results on the Binet, the PPVT, and the WISC 
substantiate this. There is some suggestion of it in the other data, 
although it is less clear cut. Secondly, we believe that our data 
have something to say about the relevance of the nature of the 
Public school and the community jn which it is imbedded for 
Maintaining the gains made during an intervention program. The 
Schools to which most of our children go are good schools in 
Many respects. In others, they leave something to be desired. All 
Of our distal children and all but nine of our local children are 
in schools in which during the past year all children and almost 
all teachers were Negro. They continue to live in the same segre- 
gated communities, which have not changed greatly over the 
five years we have been testing the children. We are inclined to 
think that two things may be important here. One is that the mo- 
livational and cognitive patterns which we have tried to instill 
in our experimental children have not been sufficiently capitalized 
Upon by the schools, since these schools deal largely with chil- 
dren that were like ours before our intervention project began. 
The other is that in these schools there appears to be somewhat 
More concern for the outward appearance of the school and its 


Pupils than there is for the learning of the children. This is сһаг- 
» Acteristic of schools in deprived neighborhoods; ours are not un- 
achievement may suffer. 


u 
Sual. It does mean, however, that 


TABLE 6 
Metrop olitan Achievement Test Scores: Mean Gains from 1965 
to 1966 of Two Groups of ETP Children. 
Word. 
N fea Disc. Reading Arithm. 
EP Ss w MUNERE noe ur 
5 who transferred 

г Wite Schol in 1965 9 ж 15 1.35 1.40 

ашп who remained 

li 1001 mate 

Q to the first grou ЫТ оп ; i: 1% с Ц 

Difference. ; 
“entra ш 24 59 46 .68 


л nsferred group B : 
j 
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As one check on this possibility, we thought it would be in- 
teresting to compare the gain scores of the nine children who 
transferred to previously all white schools in the fall of 1965 with 
a group of nine children who did not transfer but who were 
matched on IQ, and, as best we could, on parental aspirations. 
These findings are shown in : . . Table 6. With the small num- 
ber of cases, and the difficulty of providing an adequate match 
in terms of motivational variables, I do not put too much credence 
in our findings. Nevertheless it is interesting to see that all dif- 
ferences favor the transferring children, and, that except in word 
knowledge, differences are sizeable. 

Not only the school, but also the home, must be considered. 
Certainly, if no massive changes are made in the home conditions 
of children, it would be surprising if the situation that created 
the original deficit did not continue to take its toll. Our home 
visitor did work with each mother in a weekly session. Once 4 
week for only two or three years, however, is hardly enough to 
bring the mother up to providing a home situation analogous 10 
that of a more favored middle class child, who is the one who 
makes the “normal” progress on aptitude and achievement tests. 

We began the Early Training Project with the question as 10 
whether it is possible to offset the progressive retardation usually 


Observed in deprived children as they go through the years of ele- 
mentary school. We have not answered the question, yes ог no: 
It probably can only be answered, “I 


à [ t depends." It depends first 
on the intervention program, but the intervention program can- 
not carry the whole burden. We suspect that it is possible to 
offset progressive retardation by a carefully designed preschool 
program—ours at least has lasted through the second year of 
school—but that it is folly to hope that such a program can соп" 
tinue to offset inadequate schools in later years. Our findings 
on horizontal and vertical diffusion make us hopeful that inter- 
vention programs can have long lasting effects that go beyond 
the immediate children with whom one may be working. Such 
programs, however, cannot be expected to carry the whole bur- 
den of providing adequate Schooling for children from deprived 


она they сап only provide a basis for future progress 
ip schools and homes that can build upon this early interven- 
ion. 


ШКА 


Тһе Inheritance of Mental Ability 


CYRIL Burt 


Re. E 
search indicating that the process of mental development 


4, " 
A efebi and that a person’s intellectual capacity depends 
E Бен on the kind of intellectual “nourishment” avail- > 
AIR m as he grows toward maturity does not prove that 
GEN E differences in intelligence result only from environ- 
Клен, ifferences. In fact, there is а large and growing body of 
he е that heredity plays а major part in such differences. 
Paper reprinted here is a wise and comprehensive survey of 


J 
nuch of this evidence by an English psychologist, Cyril Burt, 
d productive lifetime added 


p own research over a long an 
ip a to what we know about intelligence and how it develops. 
s а slightly abridged version of "The Inheritance of Mental 
Д American Psychologist. 1958, 13, 1-15. It is reprinted 
cal ho permission of the author and the American Psychologi- 
e ssociation. (At the suggestion of the author, Table 1 has 

replaced by another table based оп а larger number of 


Subj, 
‘jects, resulting from additional work since 1958.) 


T 
HE PROBLEM OF INDIVIDUAL DIFFERENCES 
jest applications of the new 


I NN 
п Britain as in America, the earl 
concerned chiefly with the 


dog 
o. niques of mental testing were 
ег end of the intellectual scale. They were readily accepted 


üs В T 
Ge Practical aids to the doctor in diagnosing the mentally defi- 
Dt, and to the teacher in discriminating the temporarily 


Tet: E 
біздей from the irremediably dull. It was Bingham's firm 
lef that: “in the long run it would be even more profitable to 
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discover and aid the bright and the supernormal than to ascer- 


"tain and provide for the dull and defective.” 


In this country the traditional method of dealing with the 
problem was by means of what was popularly known as "the 
scholarship system." British teachers and parents were apt in. 
those days to think of scholarships rather as a means for reward- 
ing hard work than as a device for detecting and assisting im- 
pecunious talent. But considerable misgiving was felt over the 
erratic local distribution not only of scholarship winners but 
also of defectives. It was indeed widely affirmed that these vari- 
ations in the numbers were “largely the result of the injustice of 
the ordinary methods of examination.” Accordingly, in 1913 the 
London County Council took the unprecedented step of appoint- 
ing an official psychologist. His chief duties were to act as ref 
eree for what were sometimes known as “problem children"— 
particularly in disputed cases of feeble-mindedness and of schol- 
arship ability. 

, In the surveys that I carried out in this capacity I found that, 
in the poorer districts of the East End, there were three times as 
many certified defectives, eight times as many backward pupils, 
but only one-tenth the number of scholarship winners as were 


j reported in the well-to-do areas of London. Who or what was 10 


blame: the teachers, the homes, the traditional examination iD: 
arithmetic and English? Or the fact that the varying modicum of 
ability bestowed on each child was irretrievably fixed at birth? 
Environment or heredity, those seemed to be the alternative €x- 
planations; and each had its own enthusiastic advocates. As a rule 
the social reformers Bave one answer and the psychologists the 


During the nineteenth century the main champions of social 
reform were the philosophical radicals: Bentham, James and 
John Mill and their various followers. Their ciis was the 
maxim of Helvetius: l'education peut tout; or, as James Mill put 
it, if education cannot do everything, there is hardly anything 
it cannot do." In psychology, their one basic law was the law 0 
association; and the wide differences between one individual and 
another they attributed solely to the cumulative effects of asso- 
ciation, through the Operation of 


i c “habit, custom, training, and | 
environmental opportunity or deprivation." 


H 
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By the beginning of the twentieth century, however, most 
British psychologists had abandoned this simple creed. Impressed 
by the novel doctrines of the evolutionary school, they began to 
follow Darwin, Spencer, Huxley, and Galton in holding that 
the laws of heredity and individual variation applied to men as 
Well as to animals, to mind as well as to body. “It is not so much," 
Said Karl Pearson, "that the slums create the dullards, but 
rather that the duller stocks gravitate automatically to the slums.” 
It followed that the only cure would be to start breeding citizens 
as we breed race horses, prize rabbits, or pedigree pups. Huxley's 
Celebrated essay on the “Natural Inequality of Man” won over 
the few who still wavered. Most teachers were already converted 
by firsthand experience under the new scheme of universal edu- | 
Cation. à 

However, during the last few decades psychologists have been 
Bradually discovering that the problem is far more complicated 
than either side had originally assumed. And, largely as a re- 
Sult, there has been yet another swing of the polemical pendulum. 
An part this is due to a reluctance to support what G. K. Chester- 
lon once described as "the modernized dogma of predestination 
—a dogma calculated to paralyse all progress towards à welfare 
State": in part it has been due to a fuller appreciation of the pos- 
Sibilities of experience and learning, which in turn has involved 
à reversion to something like а rejuvenated belief in the funda- 
Mental law of association. Я Т 
_ To the British psychologist the experimental work on condi- 
tioning” seemed to offer a more precise interpretation, on a 
More adequate basis, of the traditional doctrine of association 
45 preached by Hartley and Mill; and the behaviourist school was 


Widely welcomed as substituting a more profitable line of prac- 
tical Tesearch for inconclusive speculations about heredity and 
find contemporary education- 


innate endowment, As a result, we | 
ists reminding each other of Bagley's well known dictum that, 
except for a few cases of pathological deficiency, the factor of 
heredity plays a very small part in human life, as compared with 
the factor of environment” (7); while several of their psychologi- 
Cal Colleagues quote with approval the pronouncements of Wat- 
Son: “there are inheritable differences in structure, but we no 
longer believe in inherited capacities.” “Give me,” he adds, “a 
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dozen healthy infants, and my own world to bring them Шш n 
and I'll guarantee to train any one of them to become M ДЕ? 
of specialist I might select—doctor, lawyer, artist, mercha 
chief, and even beggar-man or thief" (38, p. 104). 

A glance through the current literature will show that, Ка 
the most part, the hypotheses which our younger psychologists 
desire to challenge are the two propositions which, at the begin- 
ning of the century, were accepted almost without question E 
justifying the organization of our system of education: first, : $ 
hypothesis of general ability, i.e., the view that “up to ado es 
cence the chief differences distinguishing individual pupils 215 
differences in ‘general intelligence’ "—a view which led the Chief 
Inspector of Schools to declare that, “with a few exceptions, 
each pupil may be taught in the same class for every subject, OF, 
if mentally defective, sent to a special school on the ground that 
he is defective all round”; secondly, the hypothesis of mental 
inheritance, і.е., the view that the wide differences in the degree 


of general ability exhibited by various pupils were due mainly 
to genetic endowment. 


The Hypothesis of General Ability 


Of these two hypotheses the first was fi 
report of the “Norwood Committee”—a report which strongly 
- influenced the 


reorganization of our national education as €n- 
visaged in the Education Act of 1944. The committee maintained 
that children differed far more in quality of ability than 10 
amount; and recommended a tripartite classification of "second- 


ary" schools, based on the doctrine that pupils fall into three 
main types: a literary or abstract type, to be educated at “gram- 
mar schools"; a mechanical Or technical type, to be educated at 
"technical schools"; and a concrete or practical type to be edu- 
` cated at “modern schools.” This conception was supported by 
several leading psychologists who argued that “the statistical 
analyses of Thurstone disclose no evidence for Spearman’s factor 
of general ability, but only a number of ‘primary abilities, each 
(8 and refs.). 


more or less specialized” 
The scheme has not worked out in actual practice so success- 


rmly rejected by the - 
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fully as was hoped; and the proposal itself at once stimulated a 
large number of new inquiries. Those who still defend the tri- 
partite theory seem to overlook the vast and varied character of 
the evidence that has since become available on the issue thus 
raised. As a rule they content themselves with citing one particu- 
lar line of reasoning—usually the statistical. If, however, we 
take a wider view, we shall find that there are three or four in- 
dependent chains of converging arguments, none perhaps irref- 
Tagable by itself, but all of them tending to rehabilitate the older 
view, The evidence on which these inferences rest is drawn from 
Many different fields: introspection, observation, biology and 
Neurology, as well as statistical research. 
М In point of fact, the distinction between “general ability” and 
Special abilities” was due, not (as is so widely supposed) to 
Spearman but rather to Francis Galton, from whom Spearman, 
als he expressly states in his earlier papers, originally borrowed 
Шш Spearman, however, went on to deny the existence of “special 
abilities” which Galton had supported, on the ground that they 
Were “just relics or revivals of the obsolete theory of faculties” 
(31), It is this aspect of the Spearman doctrine that the modern 
educationist repudiates, and with it he is a little too ready to dis- 
Card “general intelligence” as well. 
However, even Galton has been 
Writers, who, in a vague and inchoate 
Somewhat similar doctrine on the basis of speculative arguments, 
Partly introspective, partly biological. Introspection, 50 the 
faculty school had claimed, revealed a sharp distinction between 
intellectual or cognitive qualities on the one hand and emotional 


9r orectic qualities on the other. Spencer and his followers ac- 
cepted this distinction, and supplemented it with biological argu- 


Ments, which in those days were almost equally conjectural. 
uring the evolution of the animal kingdom, and again during 
the development of each individual, the fundamental capacity 


Which Spencer termed intelligence 


partly anticipated by previous 
fashion, had inculcated a 


++. becomes [so he tells us] progressively differentiated into a hier- 
archy of more specialized cognitive capacities—sensory, perceptual, 
"sSOCiative, and ratiocinative, much as the trunk of a growing tree 


Тапібеѕ into boughs and twigs (32, Part iv). 
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Later writers were not so sure that the term cognition really 


furnished the best differentia: for them the real distinction wa | 
between directive or adaptive processes on the one pand ^ud | 
valuative or dynamic processes on the other; "intelligence, E 4 
Sully, “steers like a rudder; emotion and interest supply : 
Steam." A similar reinterpretation has more recently been A 
posed by Piaget in his book on The Psychology of Intelligence | 
7, pp. 4ff.). қ 

bio ds to my mind is the neurological evidence. 
Тһе alternative doctrine of distinct and independent abilities drew 


much of its support from early experiments on cerebral localiza- 
tion. These, it was claimed, 


+ ++ appear to indicate that distinct functions—motor, sensory, M 
Ceptual, associative, linguistic, and the like—can be assigned to di 
tinct and definite centres or areas within the brain. 


And this conclusion was a 
cell structure subsequentl 
bell, Brodmann, and yon 
have been severely criticiz 
Lorente de Nò, and, at U. 
Few of the older m 
amount of variabi 
brains." In their st 


areas" was based (23). Hence it now seems clear that the charts 
that used to figure i 


regards structure 1 
After all, as Sherrington so frequently pointed out, in any one 
individual each anatomical tissue—skin, bone, hair, or muscle 


and as regards function.” 
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Cortex, both in normal and defective persons, suggest that the 
quality of the nervous tissue in any given individual tends to be 
predominantly the same throughout: in low-grade defectives, 
for example, the nerve cells tend to be “visibly deficient in num- 
ber, in branching, and in regularity of arrangement in every 
Part of the cortex." The clinical work of Hughlings Jackson, the 
€xperimental researches of Sherrington, and the microscopical 
Studies of the infant brain carried out more recently by Conel and 
de Crinis, seem in many ways to provide increasing confirmation 
for Spencer’s theory of a “hierarchy of neural functions,” devel- 
Oping stage by stage out of a simpler basic activity into higher 
and more specialized forms. Even if we cannot wholly accept 
Lashley’s doctrine of the “mass action” of the brain, nevertheless 
the actual facts that he has reported are far more in keeping 
With a theory of general ability (and minor special abilities) 
than with a theory of major “special abilities” and no general 
factor. And Sholl himself concludes that “intelligence,” like 
ану, is a "general attribute of all cortical tissue" (30, p. 
1). 
„Each of the foregoing argum 
biology, and from neurology—is а 
Most we could so far claim is that, wl 


ents—from introspection, from 
dmittedly inconclusive. The 
hen taken in combination, 


Strong a priori probability in favour of Galton’s twofold theory 


Of general abilities plus special. It is at this point, therefore, that 
the psychologist is tempted to invoke the aid of statistical 
analysis. In my view, the function of statistics, at any rate in 
PSychological research, is simply to provide a more rigorous 
Method of testing alternative hypotheses. How then do the 
Various hypotheses that confront us stand up to this ordeal? 
Each’ of the three main suggestions leads to distinctive corol- 
laries which are open to statistical verification. First of all, if, as 
horndike held, there was no such thing as a general factor, but 
Only а set of independent abilities, then the cross-correlation 
etWeen the tests or assessments for those abilities should be 
Zero, or at least nonsignificant. They are not: they are always 


; Я $ 

% oth significant and positive. Secondly, if, as Spearman main- 

_ tained, there were no such thing as special abilities but only a 

“ingle general factor, the intercorrelations for every test should 
! 


|. 


the evidence from each of these separate fields sets up a fairly | 


“іа” ae 
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diminish proportionately in the same descending order (except, 
of course, for nonsignificant deviations due to sampling and the 

like): in technical language, the table of intercorrelations should 
constitute a matrix of rank one. It does not. 

Тһе third hypothesis assumes the presence of both general 
and special abilities. In the early article (3) to which I have 
already referred, I endeavoured to apply to the correlations be- 
tween mental tests the procedure which Karl Pearson had al- 
ready elaborated for use with measurements of bodily character- 
istics. In this way I sought to compare each of my various tables 
of observed coefficients with the best fitting set of theoretical 
values deduced from the hypothesis of a single "general ability" 
only; this hypothetical ability was redefined as the "highest com- 
mon factor" entering into all the processes measured in any 
given table. The fit was moderately good, but by no means per- 
fect. The differences between the observed and the theoretical 

. values were accordingly tested for statistical significance; and 
the result was to disclose small but significant clusters of residual 
correlations, common to certain: limited groups of tests only, 
thus plainly indicating the presence of certain supplementary 
abilities, This seemed definitely to clinch the double hypothesis 
put forward by Galton, Precisely the same conclusion was 
Teached in many later analyses carried out both by myself and 
by other workers with larger numbers of pupils and a greater 
variety of tests (5, 6, and refs.). 

The factorization of correlations between persons and between 


BC Occasions (with the same persons and tests) revealed, 
or at 


due, not merely to sampling 
ething essentially character- 
brain. A somewhat similar 


pendently reached by neurologists like 


Beurle, Cragg and Temperley, and Uttley and Sholl, Thus the 
type of "neuronal connectiy 


ity" suggest i gical 
study of dendritic fibres icon Bru fae Mia ar- 
Tangement of а machine working largely in accordance with the 
principles of probability" (30 апа refs.). This partly agrees with; 
though it is by no means identical with, the doctrine of "equi- | 
potentiality" put forward by Lashley; and thus further supports. 
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the value of factorial procedures as a means of investigating vari- 
ations in mental ability. 

However, what is far more important from the practical stand- 
point of educational guidance is this: in nearly every factorial 
study of cognitive ability, the general factor commonly accounts 
for quite 50% of the variance (rather more in the case of the 
young child, rather less with older age groups) while each of the 
minor factors accounts for only 1046 or less. With increasing 
age, the "group factors," which represent special abilities, con- 
tribute increasing amounts to the total variance; and this fact 
lends further support to the view that, as а result of maturation, 
Cognitive ability progressively differentiates and tends to become 
more and more specialized (10 and refs.). ү 

Be that as it may, whatever be our views on the various bio- 
logical or neurological issues, we тау, I think, safely say this: 
for purposes of prediction—forecasting what this or that indi- 
Vidual child is likely to do in school or in after-life—the general 
factor is by far the most important, though admittedly not our 
Only, guide. For all practical purposes, almost every psycholo- 
gist—even former opponents of the concept of general intelli- 
gence, like Thorndike, Brown, Thomson, and Thurstone—seems 
in the end to have come round to much the same conclusion, 
even though, for theoretical purposes, cach tends to reword it in 
à modified terminology of his own. And thus today, save for one 


Or two occasional attacks, current psychological criticism is not 

“ Ң H » 
SO much concerned with the problem of "general intelligence, 
but is directed rather against the second of our two initial propo- 


sitions; the assumption, namely, that individual differences in 
intelligence are hereditary or innate. 


The Genetic Component 

seem to be involved: (a) what 
f inheritance, (b) what precisely 
is inherited, and (c) what is 
etic factor as compared with. 


Here three distinct questions 
evidence is there for the fact © 
is the mode in which intelligence 
the relative importance of the gen 
the environmental? 5 

the facts of mental heredity 


The Fact. In controversies about 1 
Most critics have tended to assume that the two causal agencies 
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commonly discussed—heredity and environment—are not merely 
antithetical but mutually exclusive. The environmentalists ap- 
parently suppose that, once they have shown that intelligence 
_ tests are affected by environment, it follows that all differences 
in intelligence are due to nothing but environment. Similarly the 
_ thorough-going hereditarian is apt to talk as though he believed 
that differences in intelligence were due to nothing but genetic 
= constitution. This is the old familiar fallacy which I am tempted 
_ to label “nothing-buttery.” In point of fact, with a few rare ex- 
- ceptions, like eye colour or serological differences in the blood, 
| every observable characteristic that geneticists have studied has 
proved to be the product of the joint action of both heredity and 
environment. There are, in short, no such things as hereditary 
- characters: there are only hereditary tendencies. 
Now, where two contributory factors, such as heredity and 


volved, the obvious procedure will 
the other as constant as possible, 


г (шп heredity, To secure cases in which the children’s 
genetic endowment is the same, we шау turn to assessments ob- 


hy 
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“identical” twins. The mother is. 


lling to bring up two children at 
y sent to a relative ог | 


tained from monozygotic or 
not infrequently unable or unwi 
the same time, and one twin is consequenti: 
to a foster home. Owing to the strong popular prejudice against | 
Separating twins, she not unnaturally tries, as а rule, to keep | 
these arrangements secret. But patient and tactful inquiries show. 
that cases of twins brought up in different environments almost - 
from birth are in fact much commoner than is usually believed. | 
We have now collected over 30 such cases (9, ТҮТІНІ reproduce. 


the more important correlations for t 


added for comparison corresponding coe 
Other pairs, both related and unrelated. As regards intelligence 
the outstanding feature is the high correlation between the final 
assessments for the monozygotic twins, even when reared apart: 
it is almost as high as the correlation between two successive 
testings for the same individuals. On the other hand, wi С 
attainments the correlations are much lower for twins reare 
Separately than for twins reared together in the same home. | 
Several of our critics 


— Heim and Maddox, for example- 
have cited the account of analogous cases (described by Newman 
and others) as proving that intelligence is dependent on environ- 7 
ment, Thus, to take an oft-quoted pair, “Helen,” who had been 
trained as a teacher, scored with the Stanford-Binet tests an 
LQ. of 116; whereas her twin sister, “Gladys,” brought up foi 
much of her childhood in an isolated district of the Canadian. 
Rockies, scored only 92. But, says Newman, her score 
ct considering her scant educa- 
certain that the great deficiency in education 


had inhibited the development of the rather high grade of mental. 
ability with which she was endowed by heredity (25, pp. 136-144). 


+». was higher than we might expe! 


tion; and . . . it seems 


"Thus Newman's interpr n no way conflicts with ours. | 
It is sometimes alleged (24) that, since twins are born at th 
Same time, the intrauterine environment must һауе been the 
even if later on their environments 


Same for both before birth, Í ou t 
differ widely, and that quite conceivably it 1s the former that is 


crucial. As it happens, however, this rather gratuitous assumption 
Teverses the actual facts. Embryological and obstetric records 


7 
ы 
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show that, particularly with twins developed from split ova, the 
position of each in the uterus, and the subsequent development 1 
is liable to differ widely (72, рр. 123ff. and refs.) . E 
I think, therefore, that it may be safely said that, apart from 0 
the influence of some preconceived theory, few psychologists. | 
nowadays would be inclined to contest the mere fact of mental. ү 
inheritance: the most that can be plausibly alleged is that its in- — 
fluence is comparatively slight and distinctly elusive. А 
The Mode of Inheritance. Тһе majority of those who still y 
question the importance of mental inheritance, and many of 


those who support it, seem by preference to adopt entirely antic | 


quated notions of the way in which inheritable characteristics | 


are transmitted. If, as I have maintained, mental capacities are 


dependent on the physical characteristics of the brain (or, to 
Speak a little more precisely, on the structural and biochemical. 
then we should expect those | 


qualities of the nervous system), 

capacities to be inherited in accordance with the same principles 
that govern the inheritance of physical characteristics; and these ( 
Principles (except for obscure and apparently exceptional in- 

Stances of extranuclear heredity) are essentially those commonly 

associated with the name of Mendel. Many British psychologists, 

however, feel a strong and not unreasonable prejudice against 

applying “atomistic theories like Mendel's" to explain the facts 
of mental life, and consequently, 50 far as they admit the possi- 
bilities of mental inheritance at all, still cling to the old Darwinian 
Principle of blended inheritance. On this view heredity means 
“the tendency of like to beget like” (the definition quoted by 
One of them from the Oxford English Dictionary). Аз а result, 
they commonly assume that the arguments for inheritance must 
Consist in demonstrating resemblances between the parent and 
his children by means of correlations. When the two parents 
differ, then the child is still expected to consist in an intermediate | 


blend of both. . 
The approach of the modern geneticist 15 the reverse of all 
this. As he views it, the real problem is rather to explain why in 
Both for the environ- 


50 many instances “Jike begets unlike.” г 
in blended inheritance, опе of 


mentalists and for the believer : i 
Ше most puzzling phenomena is the appearance, not merely of © 
extremely dull children, in the families of the well-to-do profes- - 
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sional classes, but also of extremely bright children in families 
where both the cutural and the economic conditions of the 
parents would, one might imagine, condemn every child to 
hopeless failure. With the Mendelian hypothesis these anomalies 
are just what we should anticipate. However, the few critics 
who are familiar with the Mendelian explanation appear, as a 
tule, to suppose that it can apply only to discontinuous variations; 
and point out that intelligence, like stature, exhibits not discon- 
tinuous but continuous or graded variation. Hence, so they con- 
tend (sometimes citing the experiments of De Vries on “pure 
lines”), the apparent differences in intelligence between one 
individual and another must be due almost entirely to differences 
“іп environmental conditions, 
_ Mendel himself was the first to indicate how his theory could 
Бе extended to account for this particular difficulty. When sup- 
jplementing his experiments on the hybridization of peas by 
"hybridizing beans, and (as before) crossing white flowered plants 
vith purple, he found, that, whereas with peas the two types al- 
ays sorted out with no hint of any intermediate color, with 
‘beans the offspring displayed “а whole range of hues from white 
to deep purple.” This, he suggested, might be explained by postu- 
dating that with beans the color was determined, not by a single 
pair of alternative factors, but by a number of such pairs, each 
positive factor, when present, contributing a small additional 
amount of color. And if, as before, the recombinations are the 
effects of chance unions, then the resulting frequencies would 
_ obviously approximate to those of the normal curve. 

However, in our early surveys of London children (5, 6), We 
found that, when complete age groups were tested, the distribu- 
tion of intelligence departed significantly from that of a perfect 
normal curve: there was a swollen tail at the lower end, due to 
an excess of mental defectives, and a smaller enlargement at the 
"upper end. This and other considerations led me to put forward 
_ the tentative hypothesis that innate variations in intelligence are 
due partly to unifactor and partly to multifactor inheritance: 1.6.» 
they result. from Mendelian factors of two main kinds (no doubt 
overlapping), viz., (a) major genes responsible for comparatively 

large deviations, usually of an abnormal type, and (b) multiple 
genes whose effects are small, similar, and cumulative. 
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. Karl Pearson. (26) endeavoured to test the Mendelian theory. 
in its multifactorial form by comparing its implications with ace 
tual figures obtained for height, arm length, and similar physical | 
measurements, collected by himself and Alice Lee, from over | 
2,000 students and their relatives. The expected correlations 5 
Which he deduced for various degrees of kinship were in every. 
case far smaller than the observed coefficients. He therefore em- 


phatically rejected the hypothesis of Mendelian inheritance, and | 
fell back on the older theory of blending. However, in deriving 
ied on an over- 


his formulae and his expected values, Pearson reli 
w know to be the case, | 


of like to marry like—could be 
dominance would in every case 
since undertaken the rather formidabl 
appropriate formulae, which allow for these 
ing factors (17). And with these refinemen 
relations fit Pearson's own figures as well as could be wished. — 

My colleagues and I have applied Fisher’s methods (suitabl: ^ 
modified) to assessments for intelligence (12). The data were” 
secured in the course of surveys of the entire school population. 
in a representative L ) 


pairs of siblings, toge 
аз they were accessible) grandparents, uncles and aunts, and 


first cousins, The final assessments for the children were obtained - 
by submitting the marks from the group tests to the judgment 0! й 
the teachers who knew the children best: where the teacher dis- 
agreed with the verdict of the marks, the child was interviewed 
personally, and subjecte often on several suc- 
sessments for the à e 

curate. Nevertheless, іп almos \ 


parents, and (so far 


cessive occasions. The as 

family were naturally far less a 

every case the correlations computed from the actual data agreed 

with the theoretical values deduced from the multifactorial hy- 

pothesis far better than with the val er 

hypothesis hitherto put forward. The only appreciable discre| 
first cousins. Here, as for stature, 


ancy occurred in the case of п 
ce is larger than the the- 


the observed correlation for intelligence is АШ: 
Oretical; but the difference is not statistically significant, anc 


could readily be explained if (as has been suggested above) vari- 
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tions in intelligence are affected by a few major genes as well 
as by numerous minor genes. I may add that on sorting out figures 
for cousins of maternal, paternal, and mixed kinship. there is 
also some slight evidence suggestive of sex linkage. 

The Relative Influence of Heredity and Environment. In prac- 
tical work, however, the question most frequently raised is, not 
"whether differences in intelligence are inherited, nor even how 
E are inherited, but rather what is the relative influence of 
heredity as compared with environment. To an omnibus inquiry 
like this there can be no single answer. We can only try to de- 
termine, for this or that type of environment, for this or that 
- population, and for this or that type of assessment, how far the 
observable results appear to be influenced by each of the two 
main groups of factors. 

As Fisher's analysis has shown, formulae analogous to those 
used to deduce the expected correlations from the theoretical 
ariances can also be devised for deducing the amount of the con- 
tituent variances from the observed correlations. I have ventured 
о amplify Fishers methods (mainly on the lines of later work 
by Mather and Sewall Wright) so as to allow for unreliability 
and for the systematic effects of environment, i.e., of environ- 

ental influences which are correlated with those of heredity, 
as well as for random effects. The genetic contribution may be 
 ЕрдіСес as comprising two distinguishable portions: that due 
Cad component (or, as Fisher expresses it, to the 
essential genotypes”) and that due to the “nonfixable” (i.e. 


tests of the ordinary type taken jus 
"assessments obtained b 
Scribed (12). 


tas they stand and (b) adjusted 
y the Supplementary methods already de- 


, nearly 2396 of the total variance ap- 


‘liability, and about 77% to genetic factns aent ог to шт 
a genetic factors; with the adjusted 
assessments only about 12% (or slightly more) is apparently 
due to nongenetic influences and 88% to genetic factors, This 
of course means that the common practice of relying on tests 


^à 
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alone—usually a group test applied once only—is by no means 
a satisfactory method of assessing a child's innate ability. Better | 
assessments are obtained by submitting the test scores to the 
teachers for criticism or correction, and where necessary adjust- 
ing them by the methods described above. But such intensive in- 


quiries would be too costly for routine use except in borderline | 


cases. 
TABLE 2 5 
Analysis of Variance for Assessments of Intelligence 
Unadjusted Adjusted 
Source test scores assessments 

Genetic component: 

fixable 40.51 41.92 

nonfixable 16.65 2173 И 
Assortative mating 19.90 17.91 
Environment: 

systematic 10.60 1.43 

random 5.91 5.77 
Unreliability 6.43 524254 
TOTAL 2 100.00 100.00 


Environment appears io influence the test results chiefly іп, 


three ways: (2) the cultural amenities of the home and the educa- | 
ovided by the school can undoubtedly | 


tional opportunities рг 

ЕР Б in intelligence tests of the ordinary. 

type, since so often t n acquired facility with abstract 

and verbal modes of expression; (b) quite apart from what the | 
of an intellectual back- 


child may learn, the constant presence 1 l 
ground may stimulate (or seem to stimulate) his latent powers. 


Бу inculcating à keener motivation, a stronger interest in in- 
a habit of accurate, speedy, and diligent. 


tellectual things, and : dy, к 
Work; (c) in a few rare Cases illness or malnutrition during the 
prenatal or early postnatal stages may, almost from thenyerya 
Start, permanently impair the development of the child's central 
nervous system. The adjusted assessments may do much towards. 
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el iminating the irrelevant effects of the first two conditions; but 
t is doubtful whether they can adequately allow for the last. 


- As in almost all scientific investigations, the hypothetical 
model which has formed the basis of our inquiry involves of 
ecessity certain minor simplifications. In particular we have as- 


med, for purposes of calculation, a sharp distinction between 


tributing equal and additive doses to the sum total of each child's 
ate intelligence. We have then supposed that the effects of 
r former would on the whole be excluded if the few obviously 
athological cases (mostly found in special schools or institutions) 
re Omitted from our final calculations. However, these assump- 
ns have led several critics to accuse us of 


disrupting the individual personality into atomic bits and discrete 
5 which һауе subsequently to be joined together like a mosaic. 
Personality fit is argued] is not a mosaic but a seamless whole, 
hence the entire Mendelian hypothesis with its particulate genes, 
ch producing a unit-character or adding another unit to the same 


acter, is quite inapplicable to the facts of conscious behavior, 
a nd therefore to the study of mental capacity. 


Objections of this kind could of course be used just as well to 
е that à neuronic theory of the central nervous system is 
compatible With the facts of conscious behavior or of individual 
iriations in ability, Since nerve cells or "neural bonds" are 
ually particulate.” Nevertheless, even those neurologists who 
refer to start from a “field theory” do not wholly reject the 
1 euronic hypothesis (cf. 30). In both cases the difficulties raised 
> their force chiefly to the fact that there is a vast series of 
‘elusive processes intervening between theory and observable re- 
ilts- which the critic is exceedingly apt to forget. Moreover, criti- 
m 5 like those just cited plainly rest оп an obsolete version of 
the Mendelian doctrine. No geneticist today, I imagine, accepts 
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Р the hypothesis of the autonomous corpuscular gene; and 1 
| genotypic endowment of the individual can only affect the pheno- 
1 

f 


typic resultant through the mediation of innumerable obscur! 


biochemical steps. 
In our original papers 
against recurrent objection: 


Howard and I tried carefully to guard 
5 of this type. As we pointed oui 


the phrase “multiple factor: d to cover either (a 
relatively numerous loci each with only two allelomorphs or (Б) 


a single locus (or relatively few loci) - 
combination of the two. Hypothesis: 


о fit the facts. We are inclini 
us types may be operative i 
t to classify factors or gene 


morphs, or possibly (c) some 

b by itself would hardly seem t 
- to think that factors of all the vario 

varying degrees, and that the attemp 
should not be too severely pressed. ; 

We further assumed that in all probability the influence of such: 
factors on the individual's observable intelligence was mainly the 
indirect result of their influence on the developm a 
nervous system, and was presumal 
growth rates. And we expressly 
of any one "gene" upon intelligence might t 
multifarious consequences, and possibly à comparatively remo! 
consequence at that. Some genes шау һауе 4 larger share in th 
final result; others 2 smaller; and the rough classification of genes 
into “major” genes and “minor” was adopted primarily with а 
view to simplifying our general discussion. We ourselves find tt 
“theory of chromosomal hierarchy,” advanced by Goldschmi 
(22), especially attractive as а basis for the ultimate hierarchic 
differentiation of mental ability. ; 

However, this is not the place to enlarge on these speculatis 
interpretations. We fully admit that the simplifications involved 
in our hypothetical model mes that the figures finally deduced 
can be no more than approximations. But we maintain that ti 
error of approximation, however large, will nevertheless 
smaller than the amount of “unreliability” inevitably involved | 
all such measurements. 

In any case We must repeat that the conclusions reached are at 
best only valid in reference to the particular conditions unde! 
which they were obtained. They would not necessarily hold goo 
(a) of other mental traits, (b) of different methods of assess 


7 


INTELLIGENCE 


ment, (c) of a population at a different cultural level: much a 
Would they hold good if there were any subsequent change É 
і ion of environmental and genetic charac 


in the present distribut à E 
teristics, or (e) in the influences affecting their mutual interaction. 


HE INHERITANCE OF OTHER 
ENTAL QUALITIES 


m 


The mental trait in which we have been chiefly interested 2 
the general factor of “intelligence.” This, we readily concede, з 
but one psychological ingredient in ordinary everyday behavior. 


% ach us for apparently ignor- 


Dur critics are accustomed to repro. 


ing the rest. There are Several obvious reasons why we have dealt 
less fully with other determinants. The first and the most con 
usive is that comparatively little evidence is as yet available in 
TeBard to the genetic composition of other mental factors. We 
have, however, in the course of our surveys, met with an ap- 
Preciable number of cases which strongly suggest the inheritabil- 
ity of certain Specific abilities and disabilities, or rather of certam, 
efined tendencies that presumably underlie such disabilities— 

г icularly in our studies of memory, of visual, auditory, and 
inaesthetic imagery, and of verbal, numerical, artistic, and 
musical aptitudes (5), We have encountered other cases which 
uggest the inheritability of general emotional instability, of tem- 
peramental qualities like introversion and extraversion, and of 
certain quasi-instinctive tendencies like sex and bad temper (or 
| "pugnacity," as McDougall would have termed it). But emo- 
tional tendencies are always much more liable to be influenced 
апа altered by postnatal experiences, and in any case undergo 
considerable changes during the developmental Stages, so that all 
M Precarious. The most con- 


amily histories of children 
brought up in orphanages or residential institutions (7, especi 

р- 14 and refs.). In all these instances the evidence, such as i 
ippears to indicate that each of the characteristics mentio. 
ognitive and temperamental alike, are influenced b 
factor and by multifactor modes of inheritance—the 
З пе on the whole to predominate, but in varying de 
ji 


ally 
t is, 
ned, 


Brees. This 


И 


0 
WD results: 
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b T allis what is со СТ) 

i aracteristics, Ch mmonly found in investigations on physical 

irely) on the q aracteristics depending mainly (though not en- | 
evelopment of the long bones—such as arm length, 


eg len 
Bth, st 
and head— em and perhaps the longer dimensions of the face 
yield correlations of much the same magnitude às 
Others, like cephalic in- | 


Ose obtai 

ех, келеа Гог general intelligence. 

f € rather d pins: and particularly facial characteristics, seem 

€w) genes оге subject to the influence of single (or relatively | 

Nance, Vari which often appear to exhibit almost perfect domi- қ 

those de eee in the cartilaginous features, and particularly 
Pending on flesh and fat, are far more readily affected by 


Enviro 

nm 2 

ut e a influences (for data, see 34 and теѓѕ.). 

tention fi ondly there is а practical reason for concentrating at- 
rst of all, and chiefly, on the inheritability of general 


intelli 
Ige: 2 " 
our SCAN General intelligence, as we have seen, accounts for 
estas much ofthe) улпапсейаз апу other identifiable 
s fully borne out by our 


fact, 
Or, x 
Galton's pronouncement is thu 


n special gifts; 


5 far more important thai 
nted by nature is inadequate, the keen- 
n vain. d 


try must strive i 


al E ability appear 
> Where the allowance gra 


est wi 
ill and the stoutest indus 


intelligence sets an 
possibly attain. Мо one would ex- 
the most skilful coaching in the | 
an average child. ) 
ild who is innately 
or one whose 


e endowment of 


"ss mongolian i 
liit ; to achieve the scholasti 
slam е same way, no onc 
MS to gain a scholarship to а gran’! 
f orn ability is merely average to win first class honors at Ox- 
ога or Cambridge. No doubt, in any individual case the ascer- 
tainment of this upper limit сап never be a matter of absolute 
Certainty: an І.О. derived from tests alone falls far short of a 
trustworthy indication. ion authorities, like life in- 
уе 


surance companies, ha axim, and take 
probability for their guide. They са afford to risk 
a lavish expenditure on cases where there are fairly heavy odds 7. 
against success. A d р 

Nevertheless, 


, 
D 
it must be owned that, in Britain at any rate, the 
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existing administrative machinery is far less efficient than it might 
be. In an inquiry made just before the introduction of the PM 
cation Act of 1944 we found that "approximately 40 per cent 
those whose innate abilities are of university standard are failing 
to reach the university" (9). The new arrangements proposed by 
the act, and the postwar changes in the economic circumstances 
of the various social classes, have appreciably altered the entries 
to "grammar schools"; but it is too early to say how far they S 
have affected the composition of the universities. For grammar. | 
Schools the entries vary considerably from one area to another 
and even from year to year. The general aim is apparently 19 
provide a grammar school education for the brightest 20% of 
each age group; this corresponds to a borderline of about 113 
10. On this basis the round figures in Table 3 represent estimates 
С deduced from the information so far available. 


TABLE 3 


Estimates for Grammar School Entries 


Proportions iw 
General over Expected Actual” 
population* -+0.85 SD entries entries 
Middle Class 20% 40 08400 55% 
. Manual Class 80% 15 12 (60%) 45% 


TOTAL 100% -20 (100%) 100% | 


* The Census of Great Britain (1951) gives an estimate of 81.7 for males 
over 15, occupied or retired, falling into the classes of “Skilled,” “Mixed,” 
and “Unskilled” workers; these I have pooled in a single broad group. 
TE 
. A more intensive survey of two contrasted areas (“industrial” 

and “prosperous”) has just been published by J. E. Floud and 

her colleagues. Briefly their conclusion is that, in both areas, 

gross material handicaps have been greatly lessened, though not 
entirely eliminated. Nevertheless, in their view, the “problem of 
social wastage” is by no means overcome. The fact that, even | 
k today, a large proportion of the children from the working 
classes fail to reach the higher levels of scholastic instruction 
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р: herself attributes to the way in which the “educational 
b ег” is still widely regarded as a “middle class prerogative” to 
е anxiously watched and jealously preserved (20). 

^ I myself should be inclined to Jook rather to a difference in the 
aims and aspirations which are tradi 
The consequences seemed clearly revealed b 
the after-careers of LCC scholarship winners from the lower and 
the middle classes respectively whom my colleagues and I have 
been able to follow up (cf. 5, 9, апа refs.). The figures show 
that the abler children from the working classes, even when they. 
have obtained free places or scholarships at secondary schools of 
the “grammar” type, frequently fail to stay the course; by the 
time they are sixteen the attractions of high wages ^ : 
entertainment during leisure hours prove stronger than their de- 
Sire for further knowledge and skill, and easily overcome their 


Original resolve to face a long prospect of hard sedentary work 
in statu pupillari. Asa headmaster of a secondary school which 


receives both types of boy has put it: 


y the differences in 


wants his boy to be "selected" chiefly to 
od as anybody else's"; having done so, 
arliest possible opportunity: I do not 
press them, for the presence of those whose chief interest in life is. 
television, Hollywood films, football pools, “the dogs,” and “the girls” 
has not improved the tone of my aet And too often these "ig- 
nobler attitudes and crude ambitions" are shared by, and encouraged 
by, both parents and friends. 


The working class parent 
prove that “his child is as 8° 
he will withdraw hi 


On the other hand, if I may quote the report of an experienced 
university teacher: 


of the middle class which seeks, by paying fees that it 
can ill afford, 10 assist its children to climb, via a "public school" or 
um independent "grammar school, to a University education and a 
good honours degree in the humaner subjects, is animated by a tradi- 
ona morale which is comparatively rare in children and parents 
е other classes: those who nowadays come here on E at 
o themselves or their parents, are, on the whole. aes 
irregular attendants, and the least satisfactory students. i 


That section 


tional in the different classes. 


па of cheap | 
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Or, to quote a still more recent pronouncement of the High Mas- 

ter of St. Paul’s:1 

The parents are themselves imbued with four traditional ideals won 
_ they hand on to their posterity: self-discipline, a community ed 4 

the Christian religion, and a readiness to accept social responsibility 


j 2 2 3 В 556 
. ven at the sacrifice of material enjoyments—a genuine noblesse. 
- oblige. 


Underlying all these differences in outlook I ai am tempted — 
. to suspect an innate and transmissible difference in temper? un 
mental stability and in character, or in the neurophysiologicA | 1 
_ basis on which such temperamental and moral differences ten 

to be built up. Tradition may explain much: it can hardly pr 
- count for all. However, it would be idle to pursue such specula- 
. tions here in the absence of more adequate data. 


. NEED FOR FURTHER RESEARCH 


. To my mind the most pressing need at the moment is for more 
extensive research. Hitherto the most active investigators have 
been research-students, with little or no experience of the ways of 
children or the conditions of the classroom. For the requisite fa- 
cilities, and for any supplementary information they may want, 
they have to rely on the goodwill of the busy teacher. And one 
important factor is still more often overlooked: the motivation 
_ of the children themselves. This takes two Obvious forms. There 
ds first what may be called direct or short distance motivation. 
_ As actual trial has repeatedly shown, neither pupils nor students 

are likely to exert their full powers in a test conduc: 
_ in the interests of someone else's research; 


б 


4 rsity depends on 
their performances, the average score may rise 5 to 10 IQ points 


higher. Secondly, there are the effects of indirect or long distance 

otivation: the influence of parental attitudes, of teachers’ ex- 
hortations, and (most of all perhaps with British lads) of the 
social pressure that arises from the opinions and the comments 
of their school fellows, and from the tone atmosphere of 


ES N. Gilkes, Independence in Education, 195 


- Will i 
in the near future perceive the 
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the sch 
ool ` 
hardly sur ОБ class to which the pupil belongs. It is therefore | 
Searches Me if the results obtained in mere academic re- 
e at times disappointing, and evince a comparatively | 


ш reliability. 
т 
E "S the good fortune to be appointed a member of the 
edge of dd : or and so not only acquired a firsthand knowl- 
ity to жс: ools, teachers, and pupils, but enjoyed full author- x 
sition what pt the timetable, examine private records, and requi- - 
must HS ever information might be wanted. Here therefore I 
Council n record my indebtedness both to the London County 
cation d facilitating these inquiries and financing their publi- 
Officers and to the teachers, social workers, and school medical 
investi D who rendered such wholehearted cooperation 1n all our | 
igations. It is to be hoped that other education authorities 
call Де practical value of systemati- | 
iM ӨТЕЙДІ ле inquiries of this kind, conducted on ап official t 
Th y those who know the schools from inside. | 
[ТАЕ е basic researches must be carried out on children rather | 
БЕН: оп students ОГ adults, With adults, it 15 much harder to 4 
т leve accurate assessments; innate tendencies are already ob- - 
5 ured and overlaid; and detailed family histories difficult to ob- | 
‘ain. In allocating adults to appropriate occupations, whether in | 
Civil life or in the fighting services, innate capacities are of little | 
Consequence, and accordingly tend to be ignored. As a result the 
Severest critics of researches On heredity are generally those | 
Whose experience of mental testing has been gained in the adult 
field. This was manifest during the symposium recently arranged 
by the Psychological Section 0 


f the British Association. Several | 
contributors, for instance: echoed remarks like those of H. 47% 
should now be 


advised that | 


Jones that "potential investigators 
the nature-nurture controversy has been shown to be an unpro- 
ductive field of research” (14); and similar conclusi ы! 
more recently been voiced by writers like Maddox, Renshaw, | 
and others, who 
nature-nurture con! 
But whether | 
psychologists, d 


troversy 
not this is now the prevailing view among 
‘not the opinion of leading geneticists. Gold- 
lvin Hall, and Calvin Stone all deplore the 
i quiries by psychologists of the present day. 
a 


* 
[КАШ 


- Goldschmidt in particular has criticized “the extreme belief of 
| contemporary Psychologists in the power of environment”—a be- 
lief which he ascribes to the “doctrine of universal conditioning, 
- Which has, until lately, dominated the behaviourist school" (76). 
In this country eminent authorities like R. A. Fisher (18, 19) 
. and Fraser Roberts (29) have not only urged the importance of 

genetic studies for psychology, but have made noteworthy con- 
- tributions of their own. E 
_ Mere statistical inquiries, however, can never suffice. In this 
country one of the most Obvious needs is a series of intensive 
| Studies of able boys and girls similar to those already carried out 
On the backward, the defective, the neurotic, and the delinquent. 
- The brilliant investigation of 1,000 gifted children, started by 

"Terman and his colleagues over 30 years ago, and so assiduously 
- followed up, furnishes an admirable model (35, 36). But nothing 
like conclusive answers сап be given to the questions here raised 
‘Until far more extensive research has been undertaken on the 
fundamental problems of psychogenetics. An adequate under- 

Standing of the basic processes can be secured only if we start 
with carefully planned experiments on lowlier creatures, where 
pure strains can be obtained, breeding controlled, and successive 
generations more speedily raised. When we know more about the 
genetics of intelligence in animals, we may be able to construct 

vith greater confidence a more exact hypothesis regarding the 
transmission of intelligence іп man. 


y 


'OCIAL IMPLICATIONS 


—— After all, the practical importance of the issues involved is so 
profound and so far-reaching that it would be fatal to dismiss the 
‘problem as “unproductive” or “anachronistic” without attempt- 
ing to settle it one way or the other. No democratic state can 
afford to pass it by. If in the end the views of the early pioneers 
ould turn out to have been approximately correct—if “innate 
intelligence varies between limits at least as I а 
and 150," and if too "the average intelligence of the general. 
à opulation at maturity is little if at all aboye that of ап average 
child of thirteen or thirteen-and-a-hal then the bearing Of 
53 A 
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genetic variation on the national and social questions of the 


present day would be all too obvious. 

In our laudable eagerness to improve tl 
eration, we have been tempted to close ou 
present policy on the generations to come. The over-all efficiency 
of the citizens who make up a mation or a state must in the last 
resort depend on what has been calle 
Improved environmental amenities са! 
lasting results; but the changes іп а nation’s geneti 
are likely to prove irreversible. Throughout almost the entire 
Western world, and to a Jess extent in other areas as well, the 
last half-century ог 50 has witnessed radical modifications in the 
conditions that previously governed marriage and fertility. у 
creased mobility, enhanced freedom, new means of producti D 
new methods of government, the progressive reduction of ‘th 
traditional barriers separating different peoples and different 50- 
cial groups, and, іп our own country, the recent extensions of 
the educational ladder, all these transformations are visibly dis- 
turbing the stability alike of classes and of races. Almost inevi- 
tably they must alter the genetic constitution of what have hitherto 
been the dominant nations and the dominant stocks within those 


nations. 

From history and fro 
changes in the balance b 
affect the later destinies of рори 
times for good, sometimes 
drawn attenti 
for studying th 


\ 


m past exper! 
etween in 


esses at Work, ап 
ffects of contemporary trends. (сЁ. 
e.g, 15, pp. 49 b 170f.). Yet current БЕЗЕ A 
textbooks seem alm ignore them. Surely it is high 
time that the social р5у© ould now take up the question 
and plan a systematic series of investigations on the intricate but 
highly important issues involved. May I therefore conclude by 
endorsing, in the strongest possible terms, the verdict of Sto o 
(16), quoted by Bingham in the last letter he wrote to me: 
It is a matter of shame and regret that only an amateurish ‘beginnin 

: chologists іп applying modern genetic methods 


has been made by Psy! 
t0 fundamental study in the mature-nurture area. 


4 
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And may we hope that in the near future Bingham's “deepest 
wish” may be fulfilled, and that “a small band of enthusiasts will 


come forward to explore afresh this urgent and many-sided field 
of research.” 
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Heredity, Environment, and 
(һе Question “How” 


Д 
С ANNE ANASTASI 


this group of papers on the 


c "either-or" formulations 
which hereditary 
rs interact in the process of develop- 
shows by explanation and 


i It was noted in the introduction to 
ature-nurture problem that dogmati 


M i 
nd environmental facto 


_ ment. The final paper in this group 
examples what this way of thinking involves. By Anne Anastasi, 


x is entitled “Heredity, Environment, and the Question “Ноу,” 
А, оова Review, 1958, 65, 197-208. It is reprinted with 
the permission of the author and the American Psychological As- 


Sociation. 


к 
... Two or three decades ago, the so-called heredity-environment 
question was the center of lively controversy: Today, on the other 
hana, many psychologists look upon it as à dead issue. It is now 
a ey conceded that both hereditary and environmental fac- 
- lors enter into all behavior. The reacting organism 15 à product 
. Of its genes and its past environment, resent environment 
ү Provides the immediate stimulus for Сиг b 
Sure, it can be argued that, although à given trait may result 
from the combined influence of hereditary and environmental 
* factors, а specific difference in this trait between individuals or 
iG between groups may be traceable to either hereditary or environ- 
Nental factors alone. The design of most traditional investiga- 
tions undertaken to identity such factors, however, has been such 
( f data has fre- 


y ch 
МЛ 45 to yield inconclusive answers. The same set о 


122708 


ed 
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quently led to opposite conclusions in the hands of psychologists 
with different orientations. 

Nor have efforts to determine the proportional contribution of 
hereditary and environmental factors to observed individual dif- 
ferences in given traits met with any greater success. Apart from 
difficulties in controlling conditions, such investigations have 
usually been based upon the implicit assumption that hereditary 
and environmental factors combine in an additive fashion. Both 
geneticists and psychologists have repeatedly demonstrated, how- 
ever, that a more tenable hypothesis is that of interaction (75, 
22, 28, 40). In other words, the nature and extent of the in- 
fluence of each type of factor depend upon the contribution of 
the other. Thus the proportional contribution of heredity to the 
variance of a given trait, rather than being a constant, will vary 
under different environmental conditions. Similarly, under dif- 
ferent hereditary conditions, the relative contribution of environ- 
ment will differ. Studies designed to estimate the proportional 
contribution of heredity and environment, however, have rarely 
included measures of such interaction. The only possible conclu- 
Sion from such research would thus seem to be that both heredity 
and environment contribute to all behavior traits and that the- 
extent of their respective contributions cannot be specified for 
any trait. Small wonder that some psychologists regard the hered- 
ity-environment question as unworthy of further consideration! 

But is this really all we can find out about the operation of 
heredity and environment in the etiology of behavior? Perhaps 
we have simply been asking the wrong questions. The traditional 
questions about heredity and environment may be intrinsically 
unanswerable, Psychologists began by asking which type of fac- 
tor, hereditary or environmental, is responsible for individual 
differences in a given trait. Later, they tried to discover AOW 


much of the variance was attributable to heredity and how much 


to environment, It is the primary contention of this paper that 2 


more fruitful approach is to be found in the question "How? \ 
There is still much to be learned about the specific modus ОР” 
erandi of hereditary and environmental factors in the develop 
ment of behavioral differences. And there are several current lines 


of research which offer promising techni 3 1 
К ising techni the 
question “How?” 8 techniques for answering th? - 


” 


ты 
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VARIETY OF INTERACTION MECHANISMS 


Hereditary Factors 


If we examine some of the specific ways in which hereditary 


е may influence behavior, we cannot fail but be impressed 
H es wide diversity. At one extreme, We find such conditions 
E TP amentia and amaurotic idiocy. In these cases, 
NS in essential physical prerequisites for normal intellectual de- 
pment are lacking аз а result of hereditary metabolic dis- 
Orders. ... қ 
ҚА somewhat different situation is illustrated. by hereditary 
i ness, which may lead to intellectual retardation through in- 
E IL with normal social interaction, language development, 
k schooling. In such a case, however, the hereditary handicap 
It ЧЫЗ offset by appropriate adaptations of training procedures. 
as been said, in fact, that the degree of intellectual. back- 
Wardness of the deaf is an index of the state of development of 
Special instructional facilities. As the latter improve, the intel- 
lectual retardation associated with deafness iS correspondingly 


reduced. 
| A third example is provided by inherite 
ain physical diseases, with consequent pr 
environmental conditions are such that illness doe 
velop, a number of different behavioral effects may follow. In- 


fellectually, the individual may be handicapped bY his inability 
to attend school regularly- On the other hand, depending upon 
àge of onset, home conditions, parental status, and similar factors, 
Poor health may have the effect of concentrating the individual's 
energies upon intellectual pursuits. The curtailment of participa- 
tion in athletics and social functions may serve to strengthen 
interest іп reading and other sedentary activities. Concomitant 
circumstances would also determine the influence of such illness 
Upon personality development. nd it is well known that the 
latter effects could run ihe gamut from a deepening of human 


Sympathy to psychiatric preakdown. 

E Finally, heredity may influence beh 
pn of social stereotypes: A wide ya 
haracteristics have served 25 the visible 


d susceptibilty to cer- 
otracted ill health. If 
s in fact de- 


r through the mecha- 
herited physical 
dentifying such 


avio. 
iety of in 
cues for i 
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stereotypes. These cues thus lead to behavioral restrictions or op- 
portunities and—at a more subtle level—to social attitudes and 
expectancies. The individual's own self concept tends gradually 
to reflect such expectancies. All of these influences eventually 
leave their mark upon his abilities and inabilities, his emotional 
reactions, goals, ambitions, and outlook on life. 

The geneticist Dobzhansky illustrates this type of mechanism 
by means of a dramatic hypothetical situation. He points out 
that, if there were a culture in which the carriers of blood group 
АВ were considered aristocrats and those of blood group О la- 
borers, then the blood-group genes would become important he- 
reditary determiners of behavior (12, p. 147). Obviously the 
association between blood group and behavior would be specific 
to that culture. But such specificity is an essential property of 
the causal mechanism under consideration. 

More realistic examples are not hard to find. The most fa- | 
miliar instances occur in connection with constitutional types; 
sex, and race. Sex and skin pigmentation obviously depend upon: 
heredity. General body build is strongly influenced by hereditary | 
components, although also susceptible to environmental modifi- 
cation. That all these physical characteristics may exert a pro- 
nounced effect upon behavior within a given culture is well 
known. It is equally apparent, of course, that in different cultures 
the behavioral correlates of such hereditary physical traits шау 
be quite unlike. A specific physical cue may be completely un- 
related to individual differences in Psychological traits in one 
culture, while closely correlated with them in another. Or it may 
be associated with totally dissimilar behavior characteristics in | 
two different cultures. | 

It might be objected that some of the illustrations which have 
been cited do not properly exemplify the operation of hereditary 
mechanisms in behavior development, since hereditary factors | 
enter only indirectly into the behavior in question. Closer exami- 
nation, however, shows this distinction to be untenable, First it | 
may be noted that the influence of heredity upon behavior 15 
always indirect. No psychological trait is ever inherited as such- | 
All we can ever say directly from behavioral observations is that 
a given trait shows evidence of being influenced by certain "in- 
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Ced unknowns." This merely defines a problem for genetic 
be ;dt does not provide a causal explanation. Unlike the 
22 groups, which are close to the level of primary gene prod- 
MENS traits are related to genes by highly indirect 
qm po routes. Even the mental deficiency associated with 
Cm etonuria is several steps removed from the chemically de- 
E. e Eae that represent its hereditary basis. Moreover, hered- 
ee ini luences cannot be dichotomized into the more direct and 
a ess direct Rather do they represent à whole “continuum of 
E rectness, along which are found all degrees of remoteness 

causal links. The examples already cited illustrate a few of the 


points on this continuum. 
_it should be noted that as we proceed along the continuum of 
indirectness, the range of variation of possible outcomes of 
hereditary factors expands rapidly. At each step in the causal 
chain, there is fresh opportunity for interaction with other heredi- 
tary factors as well as with environmental factors. And since 
each interaction in turn determines the direction of subsequent 
an ever-widening network of possible out- 
comes. If we visual ntial grid with only two 
alternatives at each point, it two possible 
Outcomes in the one-stage situation, four outcomes at the second 
stage, eight at the third, and so on in geometric progression. 
The actual situation 15 undoubtedly much more complex, since 
there will usually be more than two alternatives at any one point. 
specific genes 


Тп the case of the blood groups, the relation to spe 
itant hereditary OT environmental 
rvives at all, 


is so close that no other © y 
Conditions can alter the outco! the organism 80 
it will have the blood gtoUP determined by its genes. Among 

some variation in out- 


Psychological traits, 00 the i 
come is always possible ава result of concurrent circumstances. 
Even in cases of phenylketonuria, intellectual development. will 
exhibit some relationship with the type of care and training 
. available to the individual. hat behavioral. outcomes show pro- 
| gressive diversification 25 we proceed along the continuum of in- 

directness is brought out by the other examples which were 

_ cited. Chronic illness car Jead 10 scholarly renown Or to intel- 
| lectual immaturity; 2 mesomorphic physique can be a contribut- 
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ing factor in juvenile delinquency or in the attainment of a col- 
lege presidency! Published data on Sheldon somatotypes provide 
some support for both of the latter outcomes. 

Parenthetically, it may be noted that geneticists have some- 
times used the term “norm of reaction” to designate the range of 
variation of possible outcomes of gene properties (cf. 13, p- 
161). Thus heredity sets the “norm” or limits within which en- 
vironmental differences determine the eventual outcome. In the 
case of some traits, such as blood groups or eye color, this norm 
is much narrower than in the case of other traits. Owing to the 
rather different psychological connotations of both the words 
“norm” and “reaction,” however, it seems less confusing to 
speak of the “range of variation” in this context. 

A large portion of the continuum of hereditary influences 
which we have described coincides with the domain of somato- 
psychological relations, as defined by Barker et al. (6). Under 
this heading, Barker includes "variations in physique that affect 
the psychological situation of a person by influencing the effec- 
tiveness of his body as a tool for actions or by serving as a 
stimulus to himself or others” (6, p. 1). Relatively direct neuro- 
logical influences on behavior, which have been the traditional 
concern of physiological psychology, are excluded from this defi- 
nition, Barker being primarily concerned with what he calls the 
“social psychology of physique.” Of the examples cited in the 
present paper, deafness, severe illness, and the physical charac- 
teristics associated with social Stereotypes would meet the speci- 
fications of somatopsychological factors, 

The somatic factors to which Barker refers, 
limited to those of hereditary origin. Bodily с 
able to environmental causes operate in the s 
psychological relations as those traceable 
heredity-environment distinctions play am 
approach. 


however, are not 
onditions attribut-. 
ame sorts of somato- 
to heredity. In fact, 
inor part in Barker's 


Environmental Factors: Organic 


Turning now to an analy 
factors in behavior, we find 
which were observe > 


sis of the role of environmental 
‹ the same etiological mechanisms 
d in the case of hereditary factors, First, 
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however, we must differentiate between two classes of environ- 
: (а) those producing organic effects which 
шау; in turn influence behavior and (b) those serving as direct 
stimuli for psychological reactions. The former may be illustrated 
by food intake or by exposure to bacterial infection; the latter, by 
tribal initiation ceremonies or by a course in algebra. There are 
no completely satisfactory names by which to designate these two 
Classes of influences. In an earlier paper by Anastasi and Foley 
(4), the terms "structural" and "functional" were employed. 
However, "organic" and "behavioral" have the advantage of 
greater familiarity in this context and may be less open to mis- 
interpretation. Accordingly, these terms will be used in the pres- 
ent paper. 

Like hereditary factors, environmental influences of an organic 
Nature can also be ordered along a continuum of indirectness 
with regard to their relation to behavior. This continuum closely 
Parallels that of hereditary factors. One end is typified by such 
Conditions as mental deficiency resulting from cerebral birth in- 
Jury or from prenatal nutritional inadequacies. A more indirect 
etiological mechanism is illustrated. by severe motor disorder— 
as in certain cases of cerebral palsy—without accompanying in- 
jury to higher neurological centers. In such instances, intellectual 
retardation may occur as an indirect result of the motor handi- 
Cap, through the curtailment of educational and social activities. 
Obviously this causal mechanism corresponds closely to that of 


hereditary deafness, cited earlier in the paper. 

Finally, dd к) consider ап environmental parallel PS 
previously discussed social stereotypes which were mediated 5y 
hereditary physical cues. Let us suppose that a ypg MEE 
With mousy brown hair becomes transformed into 2! um ing 
olden blonde through environmental techniques currently т 
able іп our culture. It is highly probable that this metamorphosis 


Will alter, not only the reactions of her associates toward Ben i 
also her own self concept and subsequent behavior. pes ects 
Could range all the way fro! cial poise to a drop п 


m a rise іп 50 
Clerical accuracy! 
. Among the examp 
influences which hav 
Barker's definition of somatops 


mental influences: 


determined organic 
but the first two fit 
With the ex- 


nvironmentally 
escribed, all 
ychological factors. 


les of e 
e been d 
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ception of birth injuries and nutritional deficiencies, all fall within 
the social psychology of physique. Nevertheless, the individual 
factors exhibit wide diversity in their specific modus operandi— 
a diversity which has important practical as well as theoretical 
implications. 


Environmental Factors: Behavioral 


The second major class of environmental factors—the be- 
havioral as contrasted to the organic—are by definition direct 
influences. The immediate effect of such environmental factors 15 
always a behavioral change. To be sure, some of the initial be- 
havioral effects may themselves indirectly affect the individual's 
later behavior. But this relationship can perhaps be best con- 
ceptualized in terms of breadth and permanence of effects. Thus 
it could be said that we are now dealing, not with a continuum — 
of indirectness, as in the case of hereditary and organic-enyiron- | 
mental factors, but rather with a continuum of breadth. 

Social class membership may serve as an illustration of a rela- | 
tively broad, pervasive, and enduring environmental factor. Its” 
influence upon behavior development may operate through many. P 
channels, Thus social level may determine the range and nature | 
of intellectual stimulation provided by home and community | 
through books, music, art, play activities, and the like. Even тоге | 
far-reaching may be the effects upon interests and motivation, 25 | 
illustrated by the desire to perform abstract intellectual tasks, to | 
Surpass others in competitive Situations, to succeed іп School, or 
to gain social approval. Emotional and social traits may likewise 
be influenced by the nature of interpersonal relations characteriz- 
ing homes at different socio-economic levels. Somewhat more | 
restricted in scope than social class, although still exerting a rela- 
tively broad influence, is amount of formal schooling which the | 
individual is able to obtain. 

A factor. which may be wide or narrow in its 
upon concomitant circumstances, i 


Y 
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p some kinds of bilingualism in childhood may exert a re- 
i ing influence upon intellectual development and may under 
p conditions affect personality development adversely (2, 5 
ee A common pattern in the homes of immigrants is that the 
child speaks one language at home and another in school, so 
that his knowledge of each language is limited to certain types 
of situations. Inadequate facility with the language of the school 
interferes with the acquisition of basic concepts, intellectual skills, 
and information. The frustration engendered by scholastic diffi- 
culties may in turn lead to discouragement and general dislike of 
school, Such reactions can be found, for example, among a num- 
b. ber of Puerto Rican children in New York City schools (3). In 
the case of certain groups, moreover, the child's foreign language 
background may be perceived by himself and his associates as à 
Symbol of minority group status and may thereby augment any 


emotional maladjustment arising from such status (34). 

A. highly restricted environmental influence is to be found in 
the opportunity to acquire specific items of information. occurring 
in a particular intelligence test. The fact that such opportunities | 


may vary with culture, social class, ОГ individual experiential 
background is at the basis of the test user's concern with the 
problem of coaching and with “eulture-free” or "culture-fair" 
tests (cf. 1, 2). If the advantage or disadvantage which such 
experiential differences confer upon certain individuals is strictly 
confined to performance on the given test, it will obviously reduce 
the validity of the test and should be eliminated. ў 
.. In this connection, however, it is essential to know the breadth — 
Of the environmental influence in question. А fallacy inherent in | 
| Many attempts to develop culture-fair tests is that the breadth of | 
cultural differentials is not taken into account. Failure to con- | 
‘Sider breadth of effect likewise characterizes cert 


ain discussions | 
ог coaching. If, in coaching a student for a college admission 
s knowledge 0 


test, we can improve hi f verbal concepts and his 
| reading comprehension, he will be better equipped to succeed in 
College courses. His performance level will thus be raised, not . 


- Only on the test, but also 00 the criterion which the test is in- 
_ tended to predict. To try to devise a test which is not susceptible 
to such coaching would merely reduce the effectiveness of the | 
рр taral differentials from test 


| est. Similarly, efforts 10 rule out cultur: 
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items so as to make them equally “fair” to subjects in different 
social classes or in different cultures may merely limit the useful- 
ness of the test, since the same cultural differentials may operate 
within the broader area of behavior which the test is designed 
to sample. 


METHODOLOGICAL APPROACHES 


Тһе examples considered so far should suffice to highlight the 
wide variety of ways in which hereditary and environmental 
factors may interact in the course of behavior development. 
There is clearly a need for identifying explicitly the etiological 
mechanism whereby any given hereditary or environmental con- 
dition ultimately leads to a behavioral characteristic—in other 
words, the *how" of heredity and environment. Accordingly, we 
may now take a quick look at some promising methodological 
approaches to the question “how.” 

Within the past decade, an increasing number of studies have 
been designed to trace the connection between specific factors in 
the hereditary backgrounds or in the reactional biographies of in- 
dividuals and their observed behavioral characteristics. There has 
‘been a definite shift away from the predominantly descriptive 
and correlational approach of the earlier decades toward more 
deliberate attempts to verify explanatory hypotheses. Similarly, 
the cataloguing of group differences in Psychological traits has 
been giving way gradually to research on changes in group char- 
acteristics following altered conditions. 

Among recent methodological developments, we have chosen 
seven as being particularly relevant to the analysis of etiological 
mechanisms, The first represents an extension of selective breed- 
ing Investigations to permit the identification of specific heredi- 


tary conditions underlying the observed behavioral differences. 
When early selective 


breeding investigations such as those of 
Tryon (36) on rats indicated that “maze learning ability" was 
inherited, we were still a long way from knowing what was 
actually being iransmitted by the genes. It was obviously not 
maze learning ability" as such, Twenty—or even ten—years 
ago, some Psychologists would have suggested that it was prob- 
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ably general intelligence. And a few might even have drawn a 
parallel with the inheritance of human intelligence. 
But today investigators have been asking: Just what makes 


one group of rats learn mazes more quickly than the other? Is it 


differences in motivation, emotionality, speed of running, general 
activity level? If so, are these behavioral characteristics in turn 
dependent upon group differences in glandular development, 
body weight, brain size, biochemical factors, ОГ some other or- 
ganic conditions? A number of recent and ongoing investigations 
indicate that attempts are being made to trace, at least part of 
the way, the steps whereby certain chemical properties of the 
genes may ultimately lead to specified behavior characteristics. 

An example of such а study is provided by Searle's (31) fol- 
low-up of Tryon’s research. Working with the strains of maze- 
bright and maze-dull rats developed by Tryon, Searle demon- 
strated that the two strains differed in a number of emotional and 
motivational factors, rather than in ability. Thus the strain dif- 
ferences were traced one step further, although many links still 
remain to be found between maze learning and genes. A promis- 
ing methodological development within the same general area 18 
to be found in the recent research of Hirsch and Tryon (18). 
Utilizing a specially devised technique for measuring individual 
differences in behavior among lower organisms, these investi- 
gators launched а series of studies on selective breeding for be- 
havioral characteristics in the fruit fly, Drosophila. Such research 
can capitalize on the mass of available genetic knowledge regard- 


ing the morphology of Drosophila, as ra as on other advantages 
i ism i ic studies. 

of using such an organism 11 genetic stt : ( 
Farther evidence of current interest In the specific hereditary 


ich i jor i be found in an extensive 
factors which influence behavior is to r 
ress at the Jackson Memorial Labora- 


g in pro. 

тией Po a еды of Scott and Fuller (30). In Воле 
the project is concerned with. the behavioral Uus "n 
various breeds and cross-breeds of dogs. Analyses of some 0 e 
data gathered to date again suggest that di n pes 
formance are produced by differences ш emotional, 25 m m г 
апа peripheral processes, and that genetically cause 5 5% 

іп central processes may be either slight or поза а 2 р. 
225). In other parts of ег ame project breed difference n 
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physiological characteristics, which may in turn be related to be- 
havioral differences, have been established. 

A. second line of attack is the exploration of possible relation- 
ships between behavioral characteristics and physiological vari- 
ables which may in turn be traceable to hereditary factors. Re- 
search on EEG, autonomic balance, metabolic processes, and 
biochemical factors illustrate this approach. A lucid demonstra- 
tion of the process of tracing a psychological condition to genetic 
factors is provided by the identification and subsequent investi- 
gation of phenylpyruvic amentia. In this case, the causal chain 
from defective. gene, through metabolic disorder and consequent 
cerebral malfunctioning, to feeble-mindedness and other overt 

| Symptoms сап be described step by step (cf. 32; 33, pp. 389— 
391). Also relevant are the recent researches on neurological 
. and biochemical correlates of Schizophrenia (9). Owing to in- 
: adequate methodological controls, however, most of the findings 
| of the latter studies must be regarded as tentative (19). 

Л _ Prenatal environmental factors provide a third avenue of 
- fruitful investigation. Especially noteworthy is the recent work 
of Pasamanick and his associates (27), which demonstrated a 
tie-up between socioeconomic level, complications of pregnancy 
and parturition, and psychological disorders of the offspring. In a 
Series of studies on large samples of whites and Negroes in Balti- 
more, these investigators showed that various prenatal and para- 
natal disorders are significantly related to the Occurrence of men- 
tal defects and psychiatric disorders in the child. An important 
rocess of childbearing and 
maternal diet and in other 
onomic status. An analysis 
igher frequency of all such 
n higher socioeconomic lev- 
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шт tested at the ages of three and four years, the offspring of н 
е experimental group obtained a significantly higher mean IQ - 

| 


than did the offspring of the controls. 
Mention should also be made of animal experiments оп the | 


m of such factors as prenatal radiation and neonatal asphyxia | 
роп cerebral anomalies as well as upon subsequent behavior 
development. These experimental studies merge imperceptibly А 
ү, Ed ад E to be considered, namely, the investiga- | 

: early experience upon the eventual be- 
havioral characteristics of animals. Research in this area has 
been accumulating at а rapid rate. In 1954, Beach and Jaynes 
(8) surveyed this literature for the Psychological Bulletin, listing. 
over 130 references. Several new studies have appeared since 
that date (e.g., 14,21. 24, 25, 35). The variety of factors covered. 
ranges from the type and quantity of available food to the extent 
of contact with human culture. A large number of experiments 
have been concerned with various forms of sensory deprivation 
and with diminished opportunities for motor exercise. Effects | 
have been observed in many kinds of animals and in almost all 
aspects of behavior, including perceptual responses, motor activ- | 
tionality, and social reactions. 


Beach and Jaynes pointed out that research in 
east four distinct theoretical 


ity, learning, emo 
In their review, 
this area has been stimulated by at 1 

interests. Some studies were motivate 
with the relative contribution of maturation and learning to 
ment. Othe 5 
infantile experiences, as 


third relevant in 

an biologist Lorenz (23) on early social 
i icular on the special type of 

as been coined. / 

е centered around 


ce of early perceptual. 


young animals. A 
work of the Europe 
stimulation of birds, шаг ог 
learning for which the term “imprinting” 
relatively large nU f тесеп! 
Hebb's (17) theory regarding the importanc 
experiences upon subsequent performance i 
All this research represents y growing and pro 
tack on the modus i nvironmental factors. - 

The human counterpart of i udies may be E 
in the comparative investigation of child-rearing practices 1n dif- 
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ferent cultures and subcultures. This represents the fifth approach 
in our list. An outstanding example of such a study is that by 
Whiting and Child (38), published in 1953. Utilizing data on 75 
primitive societies from the Cross-Cultural Files of the Yale In- 
stitute of Human Relations, these investigators set out to test a 
number of hypotheses regarding the relationships between child- 
rearing practices and personality development. This analysis was 
followed up by field observations in five cultures, the results of 
which have not yet been reported (cf. 37). 

Within our own culture, similar surveys have been concerned 
with the diverse psychological environments provided by different 
social classes (11). Of particular interest аге the study by Wil- 
liams and Scott (39) on the association between: socioeconomic 
level, permissiveness, and motor development among Negro chil- 

- dren, and the exploratory research by Milner (26) on the rela- 
tionship between reading readiness in first-grade children and 
patterns of parent-child interaction. Milner found that upon 

- School entrance the lower-class child seems to lack chiefly two 

| advantages enjoyed by the middle-class child. The first is de- 
| scribed as “a warm positive family atmosphere or adult-relation- 

_ Ship pattern which is more and more being recognized as a moti- 

. Yational prerequisite of any kind of adult-controlled learning.” 

_ The lower-class children in Milner's study perceived adults as 

| predominantly hostile. The second advantage is an extensive ор- 

- portunity to interact verbally with adults in the family. The latter 
point is illustrated by parental attitudes toward mealtime con- 
versation, lower-class parents tending to inhibit and discou 
such conversation, while middle-class 

Most traditional studies on child- 
designed in terms of a psychoanalyt 
for more data pertaining to other t 
Such as those of Milner on oppor! 
the resulting effects upon readin 
this direction. Another possible 
plication of the intensive obsery 
cal ecology developed by Bark 

. Verse socioeconomic groups. 


rage 
parents encourage it. 

rearing practices have been 
ic orientation, There is need 
ypes of hypotheses. Findings 
tunities for verbalization and 
B readiness represent a step in 
source of future data is the ap- 
ational techniques of psychologi- 
er and Wright (7) to widely di- 
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cited somatopsychological relationships (6). To date, little direct 
information is available on the precise operation of this class of. 
factors in psychological development. The multiplicity of ways in 
which physical traits—whether hereditary or environmental in 
origin—may influence behavior thus offers a relatively unex- 
plored field for future study. 

Тһе seventh and final approach to be considered represents an 
adaptation of traditional twin studies. From the standpoint of 
the question *How?" there is need for closer coordination be- 
tween the usual data on twin resemblance and observations of 
the family interactions of twins. Available data already suggest, 
for example, that closeness of contact and extent of environ- 
mental similarity are greater in the case of monozygotic than in 
the case of dizygotic twins (cf. 2). Information on the social re- 
actions of twins toward each other and the specialization of roles | 
is likewise of interest (2). Especially useful would be longitudinal | 
studies of twins, beginning in early infancy and following the | 
subjects through school age. The operation of differential en- | 
vironmental pressures, the development of specialized roles, and 
other environmental influences could thus be more clearly identi- 
fied and correlated with intellectual and personality changes in 
the growing twins. ^l 

Parenthetically, I should like to add a remark about the tradi- 
tional applications of the twin method, in which persons 12 dif- 
ferent degrees of hereditary and environmental relationships to 
each other are simply compared for behavioral similarity. In these | 
studies, attention has been focused principally upon the amount 
of resemblance of monozygotic as contrasted to dizygotic twins. 
Yet such a comparison is particularly difficult to interpret be- | 
cause of the many subtle difference in the environmental situa- 


tions of the two types of twins. A more fruitful comparison would 
seem to be that between dizygotic twins and siblings, for whom 
the hereditary similarity is known to be the same- In КаШпапп | 
monumental research on psychiatric disorders among twins (20), 1 
for example, one of the most convincing bits of evidence for the 

operation of hereditary factors in schizophrenia is the fact that | 
the degrees of concordance for dizygotic twins and for siblings. 


were practically identical. In contrast, it will be xe that іп 


t 
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intelligence test scores dizygotic twins resemble each other much 
more closely than do siblings—a finding which reveals the in- 
. fluence of environmental factors in intellectual development. 


SUMMARY 


The heredity-environment problem is still very much alive. Its 
. viability is assured by the gradual replacement of the questions, 
. “Which one?" and “How much?" by the more basic and appro- 

priate question, “How?” Hereditary influences—as well as envi- 
"ronmental factors of an organic nature—vary along a “continuum 
Jof indirectness.” The more indirect their connection with be- 
havior, the wider will be the range of variation of possible out- 
“comes, One extreme of the continuum of indirectness may be 
illustrated by brain damage leading to mental deficiency; the other 
extreme, by physical characteristics associated with social stereo- 
types. Examples of factors falling at intermediate points include 
deafness, physical diseases, and motor disorders. Those environ- 
mental factors which act directly upon behavior can be ordered 
along a continuum of breadth or permanence of effect, as 
exemplified by social class membership, amount of formal school- 
ing, language handicap, 
Several current lines о 
exploring the modus op 
- factors. Outstanding amo 
reditary conditions which 
selectively bred groups of 
logical variables and indiv 


relationships; and ( 
infancy to maturity, 


heterogeneity of methodology that is demanded by the wide а 
versity of ways in which hereditary and environmental factors | 
interact in behavior development. : 
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INTELLIGENCE TESTING 
_ AND ITS CRITICS 


16 
Lost: Our Intelligence? Why? 


QUINN McNEMAR 


One of the effects of the widespread concern with the issues 
discussed in preceding sections of this book was to leave an in 
pression in the minds of many psychologists, teachers, and edu- | 
cated citizens that science had proved that there was no such _ 
thing as general intelligence and that what appeared to be indi- _ 
vidual differences in intellectual ability were of no importance. i 
mn his. presidential address to the American Psychological Asso- 
ciation, Quinn McNemar launched an attack on some of the 
sources of this misconception. It is appropriate that this collec- 
tion end with a somewhat abridged version of his paper, entitled | 
"Lost: Our Intelligence? Why?", American Psychologist, 1964, | 
19, 871—882. It is reprinted with the permission of the author 


and the American Psychological Association. ! 


| 
"i 


Тһе Greeks had a word for it, but the Romans had a word with — 
better survival properties. Regardless of the word, what is now h 
called intelligence has been talked about for at least 2,000 years. 
And as long as 2,000 years before the advent of attempts to 
measure intelligence, there seems to have been recognition of the 
fact that individuals differ in intellectual ability. ) 

The earlier attempts at measuring were based on either of two: 
quite distinct conceptions: the Galton-Cattell idea that intellectual | 
ability manifests itself in simple, discrimination functioning, and | 
the Binet notion that cognitive ability reflects itself in more com- 
plex functioning. The Binet concept proved to be more fruitful, 
and by 1925 there was on the market, in addition to various ver- 

d Annual Conven- 
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sions of the Binet scale, a flood of group tests of so-called general 
intelligence. 

A few words about definition may be in order. First, it might 
be claimed that no definition is required because all intelligent 
people know what intelligence is—it is the thing that the other 
guy lacks. Second, the fact that tests of general intelligence based 
on differing definitions tend to intercorrelate about as highly as 
their respective reliabilities permit indicates that, despite the di- 
versity of definitions, the same function or process is being meas- 
ured—definitions can be more confusing than enlightening. 
"Third, that confusion might have been anticipated is evident 
from a recent reexamination of the problem of definition by Miles 
(1957). This British chappie found himself struggling with the 
awful fact that the word "definition" itself has 12 definitions. 


REASONS FOR DISCARDING THE IDE 
OF GENERAL INTELLIGENCE È 


Apparently one reason wh 
modified beyond recognition 
them. Among the supposed si 
are the following: the earlier 
prediction failures in individ 


y concepts are either discarded or ! 
is that too much is claimed for | 
trikes against general intelligence 
false claims about 10 constancy; | 
ual cases; unfounded claims that 
rue by the tests; equally un- | 
ing but cultural in- 
volved; the bugaboo that IQ i reflect uis m 2 
notion that an IQ standing fosters undesirable expectations гет 
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garding school achievement; the idea that IQ differences are | 
incompatible with democracy and lead to educational deter- - 
minism; and, finally, the great stress on general intelligence caused 
us to ignore other possible abilities. 

This last point leads us right into the problem of factor analy- | 
sis. Spearman died in battle defending his theory of g. Under 
pressure he reluctantly conceded that factors other than g might - 
exist, and he frequently said, in effect, I told you so as long ago | 
as 1906. Actually, Spearman was on the run before the inven-. 
tion of modern factor analysis, but it was not until Thurstone's | 
(1938) first major application of his centroid factor method 
that Spearman’s g became, seemingly, nonexistent. Thurstone 
said, “We have not found the general factor of Spearman” and 
“We cannot report any general common factor in the battery of 
fifty-six tests [p. vii].” As anticipated by some, Spearman was” 
not prone to admit defeat. He reworked Thurstone's data and: 
а g was found, plus some group factors. He charged that Thur- 
stone's rotational process had submerged the general factor. 

American factorists found Thurstone convincing. The descrip- | 
tion of abilities in terms of seven primaries was ап attractive 
package. The so-called primaries were more amenable to specific 
definition than the old hodgepodge called general intelligence. 
Despite the fact that Thurstone was able to replicate his find- 
_ ings on samples from two other populations, thus giving credence 
_ to his method and results, there were a couple of events that | 
led to some turbulence in his seven-dimension rarefied atmos- 
phere. The first of these was a minor study, by one of his own 
students, based on the intercorrelations of 1916 Stanford-Binet 
items, in which the g refused to be rotated out. But rather than | 
admit that this might be some kind of general intelligence, up 
author renamed it “maturational level." Incidentally, this uu 
— trates the first cardinal Principle of Psychological Progress: Give ў 
. new names to old things. MM. 

Тһе second disturber of the neat little set of primari 
à g, resulted when Thurstone took the next logical step, 
a constructing tests to measure the primaries. It 
. the primaries were themselves intercorrelated 
at the time, been expected and hoped that they 
- pendent. The Thurstones (1941, p. 26) readily ; 
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a general factor was needed to explain the interrelatedness of 
the primaries. This eventually led to the idea of oblique axes, 
which axes were regarded as representing the primaries as first- 
order factors, whereas the general factor pervading the primaries 
was dubbed a second-order factor. It began to look as though 
Spearman was being revisited, except for the little matter of 
labeling: anything called second-order could not possibly be re- 
garded as of much importance. Furthermore, it could always 
be said that, in the ability domain, it is less difficult to attribute 
psychological meaningfulness to first-order than to second-order 
factors, so why pay much attention to the latter? Thus it was 
easy for most American factorists to drop the concept of gen- 
eral intelligence and to advocate that tests thereof, despite their 
proven usefulness over the years, should be replaced by tests of 
the primaries. Hence the emergence of differential aptitude bat- 
teries, about which more later. 
Meanwhile, our British cousins did not tag along with the 
factor methods preferred on this side of the Atlantic, After all, 
_ it is possible to use factor methods that permit a sizable general 
factor, if such exists, to emerge as the very first factor. Being 
" first, it is, presto, the most important, as indeed it is as a factor 
explaining, for the starting battery as a whole, more variance 
for more tests than attributable to any American-style primary 
- factor. The methods preferred by the British also yield group 
. factors, apt to bear the same name as the primaries, but of at- 
tenuated importance. Apparently the British are skeptical of the 
multitude of ability factors being “discovered” in America, The 
Р Structure of intellect that requires 120 factors may very well lead 
s the British, and some of the rest of us, to regard our fractioni- 
. zation and fragmentation of ability, into more and more factors 


of less and less importance, as indicative of scatterbrainedness. 
_ This statement presumes that intellectual abilities are brain cen- 
tered. 

, 


In practically all areas of psychological research the demon- 
stration of trivially small minutia is doomed to failure because 
of random errors. Not so if your technique is factor analysis, 
despite its being based on the correlation coefficient —that slip- 
periest of all statistical measures, By some magic, hypotheses 
are tested without Significance tests, This happy situation per- 


[ 
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mits me to announce a Principle of Psychological Regress: Use 
statistical techniques that lack inferential power. This will not | 
inhibit your power of subjective inference and consequently will: 
progress you right back to the good old days when there was - 
no strangling stat or sticky stix to make your insignificant data 
insignificant. 

It may be a long time before we have an ivory tower, strictly: 
scientific resolution of the issue as to whether a scheme involv- 
ing primary abilities plus a deemphasized g is preferable to one 
involving an emphasized g plus group factors. With bigger and 
better computers we will have bigger, though not necessarily bet- 
ter, factor-analytic studies, but it seems unlikely that such fur- 
ther studies will, in and of themselves, settle the issue under dis- 
cussion. Until such time as some genius resolves the broader 
question, so ably discussed by Lee Cronbach in 1957, of the 
place, if any, of correlational method in a science that aspires 
to be experimental, we may have to turn to the criterion of 50- 
cial usefulness as a basis for judging whether it is wise to dis- 
card general intelligence. Like it or not, much of our heritag 
in this area is that earlier workers, from Binet on, had as their 
motivation the solution of social problems, and currently many 
in the area have a similar motivation. \ 


THE BEARING OF SOCIAL USEFULNESS 


In practice, if you believe that the concept of general intelli: 
gence has outlived its usefulness, you may choose from amon. 
several differential, or multiple, aptitude batteries, which wil 
provide measures of some of the so-called primary mental abili- 
ties. If you happen to believe that there is something to general 
ability, you can find tests to use. The novice looking for these - 
latter tests may have to alert himself to the first Principle of 
Psychological Progress—the test labels may have changed Бола 
“general intelligence” to “general classification” or “scholastic - 
aptitude.” If you enjoy riding the fence, you might become 4 
devotee of the practice of the College Board, and others, and 
measure just two abilities: Verbal and Quantitative. | \ 

This is certainly not the place to review the voluminous de 

' 
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_ erature that amply demonstrates the practical utility of tests of 
_ general intelligence. Nor is it the place to catalog the misuses М 
б of the Stanford-Binet for purposes which Terman never claimed | 
for it, or the misuses of the Wechsler scales for purposes which 
Wechsler has claimed for his scales. Neither the Binet nor the 
к Wechsler provides a factorially pure, unidimensional measure of 
_ а g. The current Stanford-Binet was in reality constructed too 
4 early to benefit from the implication of factor an 
- purity, whereas the Wechsler Scales were based o 
Ме premise that 10 or 11 subtests can simultan: 
_ diagnostic subscores and а meaningful total score, Of the many 
` -group tests that appeared between 1920 and 1945 it can be said 
that few, if any, provide unidimensional measures of general 
intelligence. The chief difficulty is that most of them lead to a 
7 total score based on a mixture of verbal and mathem: 
_ terial. Thus, with two main sources of variance, marked quali- t 
tative differences can exist for quantitatively similar total scores. NE 
The College Board-Educational Testin. 
tifiably refrained from giving a total score involving v 
- math, but there are those who question the usefuln 
- Board's math score and there are those who criticize 


alysis for test 
n the impossi- 
eously provide 


atical ma- 


“the old-fashioned general intelligence test was t 

greater predictive power, a power which could 
higher validity coefficients for specific subject 
aps, for overall achievement. It was hoped that such а batte 
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woul 5 mm : | 
E Бе каду песа Es cuum factors (or subtests); 
E ons Ee nt in some areas than in 
ШАТ mably each factor (or subtest) should have. 
E. d ha ulness, If a battery were truly differential, it would | 
г n to school guidance personnel. | 
E" ie manual of the DAT of the Psychological Corpora- | 
AR, ntains a staggering total of 4,096, yes, I counted 'em, 
m y coefficients. With such a large pool to draw from, one | 
ism by gracious selection “show” that the DAT is the answer - 
е prayer of every counselor, male or female, or by malicious | 
selection one could "prove" that the DAT is far worse than an { 
test ever published. The validity coefficients range all the way 
down to —.37, which is presumably а chance deviation down- 
. ward from 0, and all the way up to 90, which is likely not a | 
chance deviation downward from unity, But ranges tell us noth- - 
ing. After a careful perusal of the 4,096 correlations, it seems 
- safe to summarize DAT validities as follows: ‹ 
EE Verbal Reasoning (analogies to most of you) is the bes е 
single predictor; Language ‘Usage, as represented by a sentence 
test dealing with grammar and word usage, and admittedly more 
achievement than aptitude, is a close second. 


2. Numerical Ability, as measured by a test of simple arith: 
thmetic reasoning withou' 


. metic operations, designed to tap ari 
the usual verbal component, is the best predictor of achievement 
does not, however, correlate as well 


in school mathematics. It 
science as does Verbal Reasoning. 


NX 3. Aside from the Numerical Ability test, the only other test 
= that shows differential power as à predictor is the Spelling test 
—if you cannot spell you may have trouble learning shorthand. 
4. The remaining five tests in the battery simply fail to show. 
compelling evidence that they are good in the differential pre- 
dictive sense. For the Mechanical Reasoning and the Clerical 
Speed and Accuracy test this may be understandable in th 
little of the school curricula for Grades 8 through 12 requires 
. such abilities, but one would expect that Abstrac Reasoning and 
Space Relations would fare better than they seem 10. м 
ny Such data as we have been abl: 
.. multitest batteries tend to support 
_ Aside from tests of numerical ability 


with grades in 


these findings On the DAT. 
having differential value | 
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for predicting school grades in math, it seems safe to conclude 
that the worth of the multitest batteries as differential predictors 
of achievement in school has not been demonstrated. Inciden- 
tally, the fact that the Verbal and Numerical tests stand out as 
the only two useful predictors tends to provide some support for 
the Educational Testing Service-College Board practice of pro- 
viding scores for just these two abilities. 

And now we come to a very disturbing aspect of the situation. 
"Those who have constructed and marketed multiple aptitude bat- 
teries, and advocated that they be used instead of tests of gen- 
eral intelligence, seem never to have bothered to demonstrate 
whether or not multitest batteries provide better predictions than 
the old-fashioned scale of general intelligence. Be it noted that 
We are not discussing experimental editions of tests. Some may 
say that insofar as a test publisher provides validity data for a | 
new battery it is not necessary to show that the validities are, 
for the given school condition, better than those of other tests. 
With this one can agree, but only in case no claims are made, 
explicitly or implicitly, regarding superior merits for the new 
battery. 

It is far from clear that tests of general intelligence have been. 
outmoded by the multitest batteries as the more useful predic- 
tors of school achievement. Indeed, one can use the vast ac- 


. cumulation of data on the validity of the Psychological Cor- 
| poration's DAT to show that better predictions are possible via 
. old-fashioned general intelligence tests. Consider the fact that a 


combination of the tests Verbal Reasoning (analogies) and 
Numerical Ability would be, in terms of content, very similar 
to many group tests of general intelligence. Consider also that 
an equally weighted combination of these two tests correlates in 
the mid-.80s with the Otis S-A, Higher Form. Then, when you 
turn to a careful study of the empirical validities, as reported 
in the DAT manual, you will not be surprised at the outcome 
of the application of a little arithmetic, which leads to the defi- 
nite conclusion that a simple unweighted combination of the 
Verbal Reasoning and Numerical Ability tests predicts as well 
as or, in most instances, better than any subtest taken singly, 
or in the differential sense. 
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The manual for the DAT contains the following statement 


(Bennett, Seashore, & Wesman, 1952): 


Apparently the Verbal Reasoning and Numerical Ability tests сап 


Serve most purposes for which a general mental ability test is usually. 
given in addition to providing differential clues useful to the coun- 
selor. Hence, the use of the so-called intelligence test is apparently 
unnecessary where the Differential Aptitude Tests are being used 


EOS Пр. 711. 


Anyone who disagrees with this quotation could, with better 
justification, say that an intelligence test can serve nearly all, if 
not all, the purposes for which a multiple aptitude battery is 
given in the schools because the former, in general, is a better 
| predictor and because, as we saw earlier, the differential clues 


are too fragmentary to be of use to the counselor. And there is 
iod of testing, compared to six pe- 


h less costly. A third bonus: fewer 
y confused minds of most school 


- counselors. 
Thus, we come to the conclusion that general intelligence has 
not been lost in the trend to test more and more abilities; it was 
merely misplaced by а misplaced emphasis on à hope that а lot: 
of us, including the speaker, once entertained, a hope that in 
turn was based on a misplaced faith in factor analysis: the hope 
that factors, when and if measured, would find great usefulness 
in the affairs of society. By the criterion of social usefulness, 
the multiple aptitude batteries һауе been found wanting. Now, 
|... Ihave no desire to furnish ammunition for those test critics who 

= would have us stop all testing merely because they find a trivially 
отеу standardized test. At a time when there is shout- 
. ing about the tyranny of the testers and the brass of the brain 
watchers, at a time when school people are showing resentment 
а the disruption caused by too many national testing programs, 
Mora time when federal and state legislators are 

_ to write legislation that places restrictions on the use of tests, 
| and at à time when both majorities and minorities are being 

denied the benefits of test-based guidance because certain well- 


all too willing À 
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intentioned persons fail to realize that scores for the under- | 
privileged minorities are useful indices of immediate, or present, 
М functioning—at a time when all these and other forces are op- 
erating to throw out the tests, it is high time for the profession 
. to establish a bureau of standards to test the tests instead of 
coasting down a road that is tinged with some of the trappings 
of Madison Avenue. Better to have informed internal control 

than ignorant, hostile, external control. 


INTELLIGENCE ELSEWHERE? 


Aside from the near loss of the idea that progress in Eo 
may depend on general intelligence, one wonders whether inte 
- ligence has come to be regarded as unimportant in other ar ^ 
Any of you who: have money invested in stocks and i 


industry managers should read Edwin Ghiselli's (1963) Bin 
ham Lecture. His summary of his own work indicates that t| 
average intelligence of those іп the upper and middle тап: 
ment levels falls at the ninety-sixth percentile of the populat 
Thomas Harrell (1961) came (о а similar conclusion. Fu 
- more, management level is correlated with intelligence—you, a 
be too dumb to succeed as a manager. Also you can ‘be te 
2 bright to be a managerial success! Now it must be admitt d that 
1% little, if anything, is known about whether management success 7 


abilities. On this you are free to guess—most of. you will | 
$ already guessed my guess. KOT 
—. A one-by-one cataloguing of what we know or do not know 
ғ about what abilities contribute to success within vari us oco 
yi X 


“ness of this presentation, so let us ‘turn to some of the. 
" | esoteric fields of psychology to see whether the concept. vh 
. eral intelligence has or has had any relevance. One such fiel 


fence into this field is ; apt to be astonished at the visible 
The definition of creativity is confounded by the divers 
у subareas within the field, the criterion problems are f: "s 
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licked, and so little is known. about the creative process that 
measuring instruments are, seemingly, chosen on a trial-and-error 
basis. . . - 
[McNemar summarizes here a number of studies purporting 
to show that intelligence plays only a minor role in creative 
achievement and that the correlation between tested intelligence 
and creativity is very low. He concludes that such studies do not | 
prove their points because of defects in their design.] 1 
М Next we turn to a few studies of creativity which cannot be | 
d because of restriction of range on the criteria—these 
d this problem by never having actual cri- 
- terion information. The approach is to claim that certain tests, 
i which typically are scored for novel responses or novel solutions 
to problems, are measures of creativity, with no evidence what- 
_ soever that the tests have predictive. validity for nontest, real-life 
‘creative performance. This bit of ignorance does not prove to af 
bea handicap to those who think that creativity can be studied oA 
‘without the nuisance of obtaining criterion measures. We re- 
Juctantly accept the test-based criteria solely for the sake of 
“seeing what happens to general intelligence as a part of the pic- 
Time permits only three examples. р ^ ЧЕ 
te that general intelligence has not manifested it- 
'se relate of so-called creativity tests in the factor- | 
ДЕ as а сог tivity. The explanation for this is easily | 
elligence are used in these | 
for studying creativity, a cer- — 
that “we must look well be- 
f the IQ if we are to fathom the domain x 
448]." He went on to say, the conception "that D 
for in terms of high intelli- 
but has been largely 


criticize 
studies simply avoi 


sing his plans 
4, 1950) said 


n 


T 


: 2 О е 
js for acc ОРЫНЫ f this one сап agree, but does it. 


sole Гр. 45417 With a раі 9 A 
eople [p. 4541 V prejudge the Sa 


Q to fathom creativity? Appare! 
predict that the correl 
np i ‹ " 
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of creativity tests “аге only moderate or low," was unwilling to 
include an IQ test for the sake of finding out. However, nega- 
tion by omission is not very convincing. 

That at least one test bearing the label "creativity" is corre- 
lated more than moderately with IQ is evidenced by the value 


-of .67 (average for boys and girls) for the carefully chosen sam- 


ple of 15-year-olds in Project Talent (Shaycoft, Dailey, Orr, 
Neyman, & Sherman, 1963). This sample-stable r (based on a 
total N of 7,648) becomes .80 when corrected for attenuation. 

In a recent extensive Study (Getzels & Jackson, 1962), al- 
ready extensively criticized, creativity is defined as the sum of 
Scores on five tests (median intercorrelation of only .28). Al- 
though the investipators use the sum score for most of their 
analyses, they do not bother to report the correlation of crea- 
tivity, so defined, with 10. From the published report I have 
ascertained (via the correlation-of-sums formula) that creativity 
and IQ correlate to the extent of .40 for the total of 533 cases. 
Now this r of .40 has been greatly attenuated because of three 
things: first, the usual measurement errors; second, the cases 
were highly selected on IQ (mean of 132); third, the IQs are 
a mixture from the Stanford-Binet, Henmon-Nelson, and Wechs- 
ler Intelligence Scale for Children (the use of regression-esti- 
mated Binet IQs from the other two scales aggravates rather 
than improves the mixture). We deduce that intelligence and 
creativity tests used here have far more common variance than 
the authors believe. 


Much is made of the finding that the creativity tests tended 


. to correlate higher than did IQ with verbal-content School 


achievements. Again the IQ comes in for an unfair drubbing 
because of the same mixture of IQ scores and, what is more 


- pertinent, because of explicit selective curtailment on the 10 


variable and only incidental selection on the creativity variable, 
! Of more importance to the present paper is the analysis, by 
these same authors, based on a high IQ group and a high crea- 


tive group, these groups being selected as the top 20% for each 


variable but excluding those who were in the top 20% on both 
variables. These two selected groups were then contrasted on 
total school achievement (and a host of other variables that are 
of no interest here). The mean IQ for the high IQ group was 


| 
i 
| 


LOST: OUR INTELLIGENCE? WHY? 271 
150 whereas the mean IQ for the high creative group was 127, 
yet the achievement means of the two groups were *unexpec- 
tedly” equally superior to the school population mean despite 
the 23-point difference in mean IQ. The authors say that it “is 
quite surprising” that the high creativity group achieved so well. 
From this it is concluded that the “creative instruments account 
for a significant portion of the variance in school achievement 
[p. 24],” and the subsequent argument implies that creativity is 
more important for ordinary school achievement than is the IQ. 
‘Now anyone who is at all familiar with a three-variate problem 
. will not be "unexpectedly" surprised at the foregoing results— 
indeed, if the authors had bothered to give the three basic cor- 
m ‘relations among the three variables (IQ; creativity, and total 
school achievement) for the entire group, any person versed in 
simple multivariate analysis could deduce the results. Further- 
- more, he could deduce а further result (and this one has been 
ү he critics) which might be unpleasantly surpris- 
these authors: namely, the high IQ and the 
i in school achievement de- 
pite an unreported difference in mean creativity that is of the 
ch stressed difference in IQ.? Utilizing the 
-. half-blind logic of the authors, one can say that creative ability 
_ ds not as important as IQ for school achievement—just the op- 
- posite of their position. МЕТ F 
: Now the fact that seven of nine replications of this study con- 
- firm the original findings merely indicates that repetition of the 
_ same faulty design and false logic will lead to the same false 
d ‘conclusions. The design being used is such that, if two yariaples 
are equally correlated ‘with a third, the conclusion will be reached 
at the two are actually unequally correlated with the third. 
. "This is the neatest trick of the decade for supplying educationists 
- with an antidote for the IQ virus. I cannot refrain from saying 
at this point that, although discouraged, Тат still hopeful that 
оше who. do statistical studies will first learn а modicum of 


_ elementary statistics! | ж AM 
| Time does not permit а discussion of other studies in which 
creativity is defined in terms performance instead of be- 
en, the replication stud 
ate this deduction. 


of test 
y of Yamamoto (1964) 


А Since this was writt 
ives data that corrobor 
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ing based on actual creativity of the sort prized by society. In 
summary of this brief on creativity studies, I would like to offer 
a few dogmatic-sounding Observations. First, one need not be 
surprised at the fact that so-called creativity tests do not yield 
high correlations with IQ tests—but the correlations are веп- 
егаПу far higher than those found in typical studies with range 
restrictions. І would anticipate that for normalized scores, the 
uncurtailed scatters for IQ versus creativity tests will be bivari- | 
М ate normal. Second, if we have honest to goodness criterion | 
measures of literary or architectural or Scientific creativity, the 


гу wide range of crea- 
tivity, whereas as we go down to average IQ, and on down to 
lower levels, the scatter for creativity will be less and less. Нау- | 

ing a high IQ is not a guarantee of being creative; havingalow | 
IQ means creativity is impossible. Third, it remains to be se 


I am concerned, to claim factorial validity for creativity tests, - 
terms of tests, is an un. 
ntal problem of validi! 
. The recently renewed interest in "gifted" children, along with- 
the flurry of creativity studies, has led to a reexamination о 

t has long been recogn 
. that identification in terms of high 10 is too narrow—thos 
gifted in such areas as art and music would be overlooked. 


_ the use of creativity 
that these creativity 
music. Тү 
+ We are being told that it is important “to identify reati, 
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talent early in life," hence you need not be surprised that the 


search goes down to the kindergarten level, with claims of suc- 
cessful identification. The creativity tests ате presumed to be 
better for this purpose than the IQ tests because of the failure 
of the IQ to be constant, an argument that completely overlooks 
the fact that the IQ does have some constancy whereas abso- 


lutely nothing is known about the stability of standings on crea- 
tivity tests. The 10 tests, known 10 be imperfectly valid as pre- 
п life, are to be replaced by 


dictors of outstanding achievement i 

"the creativity tests, known to be of unknown validity as predic- 
_ tors. Anyway, progress, defined as change, is in the offing. 
Тһе IQ is being linked with learning as an outmoded educa- 
tional objective; the new objective involves an emphasis Оп 
- thinking. Somehow or other creativity, not general intelligence, ^ 
being associated with thinking. The horrible idea of under- 
achievers and overachievers, іп terms of expectancies based on 
the IQ, will be abolished. But no thought is given to the fact 
hat the use of creativity tests will simply define a new crop of 


ider- and overachievers. 

! In an apparent zeal to rid us of general intelligence, it is ar- 

_ gued that measured creativity is significantly related to ordinary | 
E 1 never, never does one find 


hool achievement. Maybe 50, but ni 
orted as to the relative sizes of validity coeffi- 


have seen, the technique being used will show | 
ts are unequal. Why not the full facts, free. 


_ Ап additional difficulty is not being faced by those who would 
: sts by creativity tests, ОГ creative-thinking tests. The | 
; і no, ога trivially small, gen- į 
yet these self-characterized 
rs (see Torrance, 1963) do not hesi- - 


which 


mplete data тер 
jue ients. And, as We 
. that equal coefficien 


! tate to advocate a 
29 "red the curriculum to 
D d: thinking will not overe 

а 


Е їп, І ехргеѕѕ the hope that 
_ better rather,than by s 

2 n "here are other areas, such as rea 

oncept formation, in which one mig) 

deration of intelligence аз ап aspect. One mi 
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that investigators of thinking would have something to say about 
individual differences in thinking being dependent upon intelli- 
gence, but for some unintelligent reason these people seem never 
to mention intelligence. Surely, it cannot be inferred that think- 
ing about thinking does not involve intelligence! 


% 
IN CONCLUSION 


paper that the concept of gen- 
maligned by a few, regarded as 
me, and discarded or ignored by 
others, still has a rightful place in the science of psychology and 
in the practical affairs of man. It has not been argued that the 
nature of general intelligence is well understood. Much, how- . 
ever, has been written about its nature. Over 40 years ago (In- 
telligence; 1921a, 1921b), an editor secured and published the 
reasoned views of 13 well-known test psychologists. Later, 
Spearman set forth his speculations about the nature of g. Prior 
to these, Binet had, of course, given much thought to the prob- 
lem. ТШ 

More recent discussions exist. Hebb (1949) has considered | U 
the problem from the viewpoint of neurology and brain func- ^ 
tioning. Cyril Burt (1955), always a vociferous defender of the 
concept of general intelligence, has reviewed the evidence for 
à g and restated the idea, dreadful to some, that intelligence is - 
innate. Perhaps it was inevitable that Raymond Cattell (1963), 
who has camped with the Beneral intelligence contingent, should | 
gaze into his crystal n-dimensional factor ball and find evidence | 
for crystallized as Opposed to fluid general intelligence. Joseph 
MeVicker Hunt’s (1961) book on Intelligence and Experience 
is in large part devoted to questions pertaining to the nature of | 
intelligence. ; 

By far the most provocative recent discussion that I have 
encountered is the closely reasoned 44-page paper by Keith 
Hayes (1962). He puts forth a motivational-experiential theory 
of intelligence. In essence, he presumes that there are hereditary | 
differences in motivation, "Experience-producing drives" a 
environmental differences produce differences in experience, 


It has been the thesis of this 
eral intelligence, despite being 
à second-order function by so 


T 


^ 
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which in turn, by way of learning, lead to differences in ability. 
Therefore, differences called intellectual are nothing more than 
acquired abilities. I think that Hayes has ignored the possibility 
of individual differences in learning ability, but if such a formu- 
lation leads to experimental manipulation of variables, we may 
eventually make progress in an area that has too long been domi- 
nated by ever increasing fractionization by factor analysis, with 
i little thought as to how the fractured parts get put together into 
a functioning whole. 
Abilities, or capacities, or aptitudes, or intellectual skills, or 
whateyer you choose to call them, are measured in terms of 
response products to standardized stimulus situations. The stimu- 
lus is presented to an organism which by some process comes 
up with a response; thus any attempt to theorize and/or study 
intellect in terms of a simple stimulus-response (S-R) paradigm 
"seems doomed to failure unless drastically modified and com- 
plicated by the insertion of O for organism and P for process. 
22 There have been thousands of researches on the multitudinous 
. variations from organism to organism, and the results fill books 
s. These studies can be roughly classified 


on individual difference a о 
into two types. First, those that ascertain the intercorrelations 
among scaled response products to various stimulus situations, 


known as tests, have to do with the structure of intellect; and 
Т Whether the resulting factors are anything more than dimensions 
_ for describing individual differences need not concern us here. 
E. The second type of study seeks the nontest correlates of test 
performance, and whether ог not any of the found correlates 
‘can be regarded as explaining individual differences is not of | 
interest here. Both types of studies certainly force one to stress ! 
_ the overwhelming diversity exhibited among the organisms. 
But these studies of individual differences never come to grips 
. with the process, or operation, by which a given organism 
achieves an intellectual response- Indeed, it is difficult to see how 
the available individual difference data can be used even as a 
“starting point for generating a theory as to the process nature 
Of general intelligence ог of any other specified ability. 

As a basis for a little speculation, let us conceive of a highly 
hypothetical situation in which the two members of a pair of 
dentical twins, with identical experiences, find themselves cast 
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up on an uninhabited tropical island. Let us assume that they 
are at the supergenius level, far beyond that of your favorite 
man of genius. Let us also assume that, though highly educated 
in the sciences, they have been fortunate enough to have had 
Zero exposure to psychology. In addition, we presume that, be- 
ing highly involved and abstracted in the pursuit of science, they 
have never noticed what we call individual differences in abilities. 

A quick exploration of the island assures them that food is 
plentiful, that shelter is available, and that clothing is not a 
necessity. To allay the boredom that they foresee as an eternity 
in this laborless heaven, they decide to spend their time in the 
further pursuit of science, but the lack of the wherewithal for 
constructing gadgets rules out any research in the physical sci- 
ences. Having had a college course in Bugs and Bites they pro- 
ceed to study the life of the island's insects, then the habits of 
the birds, and the antics of a couple of monkeys. The manner 
in which the monkeys adjust to the environment leads them to 
Set up some trial situations for more systematic observation, 
Needless to say, the monkeys show evidence of what we call 
learning and what we call problem solving. 

Eventually they decide that attempting to outwit each other 
might be more fun than being outwitted by the monkeys, so they 
begin to cook up and use games and problems for this purpose, 
This activity leads each to speculate and introspect about how 
problems are invented and how solved. Then by cleverly de- 
signed experiments, preceded of course by theory, they set forth 
highly developed laws and principles about what we call rea- 
Soning and problem solving. Incidentally, they switch back and 
forth between the roles of experimenter and subject, there being 
no college sophomores available. They continue for years the 
study of their own mental Operations, constantly on the alert for 
new phenomena to investigate. 

And now with apologies to the ancient Greeks, who did have 
some ideas along these lines, we leave with you the 64-million 
drachma question: Will our two identical supergeniuses, bein 


totally unaware of individual differences, ever hit upon and des | 


velop a concept of intelligence? 
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PSYCHOLOGY 
/— About this book: 


Teachers, college admissions officers, school coun 
personnel managers — these are only a segment of thë 
frequently called upon іс make decisions based (at lea 
on the results and interpretation of intelligence testing. Wa 
ап awareness of what is (and what is not) being measured, they 
are likely to place either too much or too little reliance on the in- 
formation such tests give them. Unfortunately, many of the most 
illuminating discussions and significant research reports about in- 
telligence and the problem that one faces in attempting to 
measure it are in joltnals and books not easily accessible to the 
majority of people. ‘fis collection of articles — each an important 
contribution to the understanding of intelligence measurement — 
forms a unique reader at an unsophisticated technical level, that 
will appeal to all interested in the subject, 
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